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Abstract 

To study the effect of lack of up-to-date channel state information at the transmitters (CSIT), we consider 
two-user binary fading interference channels with Delayed-CSIT. We characterize the capacity region for such 
channels under homogeneous assumption where channel gains have identical and independent distributions across 
time and space, eliminating the possibility of exploiting time/space correlation. We introduce and discuss several 
novel coding opportunities created by outdated CSIT, which can enlarge the achievable rate region. The capacity- 
achieving scheme relies on accurate combination, concatenation, and merging of these opportunities, depending on 
the channel statistics. The outer-bounds are based on an extremal inequality we develop for a binary broadcast 
channel with Delayed-CSIT We further extend the results and characterize the capacity region in the case that 
output feedback links from the receivers to the transmitters are available in addition to the delayed knowledge of 
the channel state information. 



I. Introduction 

The history of studying the impact of feedback channel in communication systems traces back to Shannon f3], 
and ever since, there have been extensive efforts to discover new techniques that exploit feedback channels in 
order to benefit wireless networks. In today's wireless networks, one of the main objectives in utilizing feedback 
channels is to provide the transmitters with the knowledge of the channel state information (CSI). In slow-fading 
networks, this task could have been carried on with negligible overhead. However, as wireless networks started 
growing in size, as mobility became an inseparable part of networks, and as fast-fading networks started playing a 
more important role, the availability of up-to-date channel state information at the transmitters (CSIT) has become 
a challenging task to accomplish. Specifically, in fast-fading scenarios, the coherence time of the channel is smaller 
than the delay of the feedback channel, and as a result, providing the transmitters with up-to-date channel state 
information is practically infeasible. 

As a result, there has been a recent growing interest in studying the effect of lack of up-to-date channel state 
information at the transmitters in wireless networks. In particular, in the context of multiple-input single-output 
(MISO) broadcast channels (BC), it was recently shown that even completely stale CSIT (a.k.a. Delayed-CSIT) can 
still be very useful and can change the scale of the capacity, measured by the degrees of freedom (DoF) |4]. A key 
idea behind the scheme proposed in Q is that instead of predicting future channel state information, transmitters 
should focus on the side-information provided in the past signaling stages via the feedback channel, and try to 
create signals that are of common interest of multiple receivers. Hence, we can increase spectral efficiency by 
retransmission of such signals of common interest. 

There have also been several recent works in the literature to understand the impact of Delayed-CSIT in wireless 
networks with distributed transmitters. This includes studying the DoF region of multi-antenna two-user Gaussian 
IC and X channel I^SJ, |^6J, fc-user Gaussian IC and X channel ||7|, |[8l, and multi-antemia two-user Gaussian IC with 
Delayed-CSIT and Shannon feedback |[9|, |10|. In particular, the DoF region of multi-anterma two-user Gaussian 



IC has been characterized in | [TT| , and it has been shown that the A:-user Gaussian IC and X channels can still 
achieve more than one DoF with Delayed-CSIT g, |[8| (for k > 2). 
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A major challenge that arises in interference channels with Delayed-CSIT is that in such networks the transmitter 
has no longer access to all the transmit signals in the network. In fact, each transmitter has only access to its own 
interference contribution. Therefore, unlike BC in which the task of creating signals of common interest could be 
simply done at a single transmitter that has access to all messages, exploiting Delayed-CSIT becomes much more 
challenging. In order to shed light on fundamental limits of communications with Delayed-CSIT in interference 
channels, in this paper we focus on a binary fading model as described below. 

We consider a two-user interference channel as illustrated in Figure [T] In this network, the channel gains at each 
time instant are either or 1 according to some Bernoulli distribution, and are independent from each other and 
over time. The input and output signals are also in the binary field and if two signals arrive simultaneously at a 
receiver, then the receiver obtains the XOR of them. We shall refer to this network as the two-user Binary Fading 
Interference Channel (BFIC). 

Rxi 

^ Yi[t]=Gn[t]Xi[t]©G2i[t]X2[t] 



^ Y2[t]=Gl2[t]Xi[t]ffiG22[t]X2[t] 
RX2 



Txi Gu[t] 




TX, G22[t] 



Fig. 1. Binary fading channel model for a two-user interference channel. The channel gains, the transmitted signals and the received signals 
are in the binary field. The channel gains are distributed as i.i.d. Bernoulli random variables. The channel gains are independent across time 
so that the transmitters cannot predict future based on the past channel state information. 

As the main motivation, we study the two-user BFIC as a stepping stone towards understanding the capacity of 
more complicated fading interference channels with Delayed-CSIT. Lately, the linear deterministic model introduced 



in 1 12 1, has been utilized to bridge the results from deterministic networks into Gaussian networks {e.g., \ 12 1-| 18 1). 
In the linear deterministic model, there is a non-negative integer representing the channel gain from a transmitter 
to a receiver. Hence, one can view the binary fading model as a fading interpretation of the linear deterministic 
model where the non-negative integer associated to each link is either or 1. The binary fading model is also 
motivated by a simple shadow fading environment, in which each link is either "on" or "off" (according to the 
shadow fading distribution), and the multiple access (MAC) is modeled such that if two signals are transmitted 
simultaneously, and the links between the corresponding transmitters and the receiver are not in deep fade, then a 
linear combination of the signals is available to the receiver. 

In this work, we fully characterize the capacity region of the two-user BFIC with Delayed-CSIT We introduce 
and discuss several novel coding opportunities, created by outdated CSIT, which can enlarge the achievable rate 
region. In particular, we propose a new transmission strategy, which is carried on over several phases. Each channel 
realization creates multiple coding opportunities which can be exploited in the next phases, to improve the rate 
region. However, we observe that merging or concatenating some of the opportunities can offer even more gain. 
To achieve the capacity region, we find the most efficient arrangement of combination, concatenation, and merging 
of the opportunities, depending on the channel statistics. This can take up to five phases of communication for 
a two-user channel. For converse arguments, we start with a genie-aided interference channel and show that the 
problem can be reduced to some particular form of broadcast channels with Delayed-CSIT We establish a new 
extremal inequality for the underlying BC, which leads to a tight outer-bound for the original interference channel. 
The established inequality provides an outer-bound on how much the transmitter in a BC can favor one receiver to 
the other using Delayed-CSIT (in terms of the entropy of the received signal at the two receivers). 

We also consider the scenario in which output feedback links are available from the receivers to the transmitters 
on top of the delayed knowledge of the channel state information. We demonstrate how output feedback can be 
utilized to further improve the achievable rates in terms of both enlarging the capacity region and improving the 
achievable sum-rate. In addition, output feedback can help us to simplify the achievability strategy significantly. 
For converse, again the core idea is to reduce the problem to a broadcast channel with Delayed-CSIT and output 
feedback, and establishing a new extremal inequality for the resultant broadcast channel. The inequality then helps 
us to prove a tight outer-bound for the original interference channel. 
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The rest of the paper is organized as follows. In Section we formulate our problem. In Section |lllj we present 
our main results and illustrate them through an example. We then provide an overview of our main achievability 



and converse techniques in Section |IVj Sections |Vp(] are dedicated to the proof of our main results. Section |xr 
concludes the paper and describes several interesting future directions. 



II. Problem Setting 

We consider the two-user Binary Fading Interference Channel (BFIC) as illustrated in Figure [2] The channel 
gain from transmitter Txj to receiver Rxj at time instant t is denoted by Gij[t], i,j G {1,2}. We assume that the 
channel gains are either or 1 (i.e. Gij[t] S {0,1}), and they are distributed as independent Bernoulli random 
variables (independent from each other and over time). We consider the homogeneous setting where 

Gij[t]iB{p), i,j = 1,2, (1) 

for < p < 1, and we define q = 1 — p. 

At each time instant t, the transmit signal at Txj is denoted by Xi[t\ G {0, 1}, and the received signal at Rxj is 
given by 

Yi[t] = Gii[t]Xi[t] e Gii[t]X-M i = l,2, (2) 

where the summation is in F2. 

Furthermore, the channel state information (CSI) at time instant t is denoted by the quadruple 

G[t] = {Gn[t],Gu[t],G2i[t],G22[t]). (3) 



W: 



W2 

Fig. 2. Two-user Binary Fading Interference Cliannel (BFIC). Tlie cliannel gains, the transmit and the received signals are in the binary 
field. The channel gains are distributed as i.i.d. Bernoulli random variables. 

We use the following notations in this paper. We use capital letters to denote random variables (RVs), e.g., Gij[t] 
is a random variable at time instant t. Furthermore for a natural number k, we set 

G' = [G[l],G[2],...,G[k]f . (4) 

Finally, we set 

Gixj e Glxi = [Gu[i]Xi[i] e g-,[i]x-[i], Gu[t]Xi[t] e GjMXMf ■ (5) 

In this paper, we consider three models for the available channel state information at the transmitters: 

1) Instantaneous-CSIT: In this model, the channel state information G* is available at each transmitter at time 
instant t, t = 1,2, . . . ,n; 

2) No-CSIT: In this model, transmitters only know the distribution from which the channel gains are drawn, but 
not the actual realizations of them; 

3) Delayed-CSIT: In this model, at time instant t, each transmitter has the knowledge of the channel state 
information up to the previous time instant (i.e. G*^^) and the distribution from which the channel gains are 
drawn, t = 1,2, ... ,n. 

We assume that the receivers have instantaneous knowledge of the CSI. Consider the scenario in which Tx^ 
wishes to reliably communicate message Wi e {1, 2, . . . , 2"^-} to Rxi during n uses of the channel, i = 1,2. We 
assume that the messages and the channel gains are mutually independent and the messages are chosen uniformly. 
For each transmitter Txj, let message Wj be encoded as using the encoding function fi{.), which depends on 
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the available CSI at Txj. Receiver Rxj is only interested in decoding Wj, and it will decode the message using the 
decoding function Wj = gi{Y^,G'^). An error occurs when W, / Wj. The average probability of decoding error 
is given by 

Ai,„ = E[P[W, /Wi]], i = l,2, (6) 

and the expectation is taken with respect to the random choice of the transmitted messages Wi and W2. A rate 
tuple R2) is said to be achievable, if there exists encoding and decoding functions at the transmitters and the 
receivers respectively, such that the decoding error probabilities Ai,n, A2,n go to zero as n goes to infinity. 

In addition to the setting described above, we consider a separate scenario in which an output feedback (OFB) link 
is available from each receiver to its corresponding transmitteiQ More precisely, we consider a noiseless feedback 
link of infinite capacity from each receiver to its corresponding transmitter. 

Due to the presence of output feedback links, the encoded signal Xi[t\ of transmitter Txj at time t, would be a 
function of its own message, previous output sequence at its receiver, and the available CSIT. For instance, with 
Delayed-CSIT and OFB, we have 

= /,[t](Wi,y/-\G*-i), i = l,2. (7) 

As stated in the introduction, our goal is to understand the impact of the channel state information and the 
output feedback, on the capacity region of the two-user Binary Fading Interference Channel. Towards that goal, 
we consider several scenarios about the availability of the CSIT and the OFB. For all scenarios, we provide exact 
characterization of the capacity region. In the next section, we present the main results of the paper. 

III. Statement of Main Results 

In this paper, we basically focus on the following scenarios about the availability of the CSI and the OFB: (1) 
Delayed-CSIT and no OFB; (2) Delayed-CSIT and OFB; and (3) Instantaneous-CSIT and OFB. In order to illustrate 
the results, we first establish the capacity region of the two-user BFIC with No-CSIT and Instantaneous-CSIT as 
our benchmarks. 



A. Benchmarks 

Our base line is the scenario in which there is no output feedback link from the receivers to the transmitters, and 
we assume the No-CSIT model. In other words, the only available knowledge at the transmitters is the distribution 
from which the channel gains are drawn. In this case, it is easy to see that for any input distribution, the two 
received signals are statistically the same, hence 

I (xj; = / (X2"; ys^lG") . (8) 

Therefore, the capacity region in this case, (JNo-csit^ jj^g same as the intersection of the capacity region of 
the multiple-access channels (MAC) formed at either of the receivers: 

^No-CSIT ^ f < i?. < p, i = 1, 2, 

The other extreme point on the available CSIT is the Instantaneous-CSIT model. The capacity region in this case 
is given in the following theorem which is proved in Appendices |A] and |B] 

Theorem 1: [Capacity Region with Instantaneous-CSIT] The capacity region of the two-user Binary Fading 
IC with Instantaneous-CSIT (and no output feedback), C^^^^""^, is the set of all rate tuples (i?i,i?2) satisfying 

^icsiT 0<Ri<p, i = 1,2, 

\ Ri+R2<l-q'^ +pq. 

Remark 1: Comparing the capacity region of the two-user BFIC with No-CSIT Q and Instantaneous-CSIT ( [T0| ), 
we observe that the bounds on individual rates remain unchanged while the sum-rate outer-bound is increased by 



'As we will see later, our result holds for the case in which output feedback links are available from each receiver to both transmitters. 
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pq. This increase can be intuitively explained as follows. The outer-bound of 1 — q^ corresponds to the fraction of 
time in which at least one of the links to each receiver is equal to 1. Therefore, this outer-bound corresponds to 
the fraction of time that each receiver gets "useful" signal. This is tight with No-CSIT since each receiver should 
be able to decode both messages. However, once we move to Instantaneous-CSIT, we can send a private message 
to one of the receivers by using those time instants in which the link from the corresponding transmitter to that 
receiver is equal to 1, but that transmitter is not interfering with the other receiver. This corresponds to pq fraction 
of the time. 

Now that we have covered the benchmarks, we are ready to present our main results. 



B. Main Results 

As first step, we consider the Delayed-CSIT model. In this case, the following theorem establishes our result. 
Theorem 2: [Capacity Region with Delayed-CSIT] The capacity region of the two-user Binary Fading IC with 
Delayed-CSIT (and no output feedback), (JDCSIT^ ^^^^ tuples {Ri,R2) satisfying 

^DCSIT^ f 0<Ri<P, ^ = 1,2, 

I R^ + {l+q)Ri<p{l + q)\ i = l,2. 



Remark 2: Comparing the capacity region of the two-user BFIC with Delayed-CSIT (111 and Instantaneous 



CSIT (10 1, we can show that for < p < (3 — \/5) /2, the two regions are equal. However, for (3 — \/5) /2 < 
p < 1, the capacity region of the two-user BFIC with Delayed-CSIT is strictly smaller than that of Instantaneous- 
CSIT. Moreover, we can show that the capacity region of the two-user BFIC with Delayed-CSIT is strictly larger 
than that of No-CSIT (except for p = or 1). 

Furthermore, since the channel state information is acquired through the feedback channel, it is also important 
to understand the impact of output feedback on the capacity region of the two-user BFIC with Delayed-CSIT. In 
the study of feedback in wireless networks, one other direction is to consider the transmitter cooperation created 
through the output feedback links. In this context, it is well-known that feedback does not increase the capacity of 
discrete memoryless point-to-point channels \3j. However, feedback can enlarge the capacity region of multi-user 



networks, even in the most basic case of the two-user memoryless multiple-access channel |19|, |20|. In |15|, 
p6} , the feedback capacity of the two-user Gaussian IC has been characterized to within a constant number of 
bits. One consequence of these results is that output feedback can provide an unbounded capacity increase. This 
is in contrast to point-to-point and multiple-access channels where feedback provides no gain and bounded gain 
respectively. In this work, we consider the scenario in which an output feedback link is available from each receiver 
to its corresponding transmitter on top of the delayed knowledge of the channel state information as depicted in 
Figure [Sfa). 




(a) (b) 

Fig. 3. Two-user Binary Tading Interference Channel: (a) with output feedback links from each receiver to its corresponding transmitter 
In this setting, the transmit signal of Txi at time instant t, would he a function of the message Wi, the available CSIT, and the output 
sequences Y^~^, i = 1,2; and (b) with output feedback links from each receiver to both transmitters. In this setting, the transmit signal of 
Txi at time instant t, would be a function of the message Wi, the available CSIT, and the output sequences Y^~^ , Yj/"^' * = 1, 2. 



In the presence of output feedback and Delayed-CSIT, we have the following result. 
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Theorem 3: [Capacity Region with Delayed-CSIT and OFB] For the two-user binary IC with Delayed-CSIT 
and OFB, the capacity region (JDCSIT.ofb^ given by 



C 



DCSIT,OFB 



i?2 € M+ S.t. R^ + {l+ q)R-i < p{l + 



1,2} 



(12) 



Remark 3: The outer-bound on the capacity region with only Delayed-CSIT ( [TT] ) is in fact the intersection of 
the outer-bounds on the individual rates (i.e. Ri < p, i = 1,2) and the capacity region with Delayed-CSIT and 



OFB (12 1. Therefore, the impact of OFB is to remove the constraints on individual rates. This can be intuitively 
explained by noting that OFB creates new path to flow information from each transmitter to its corresponding 
receiver {e.g., Txi — )• Rx2 — )■ Tx2 — Rxi). This opportunity results in elimination of the individual rate constraints 
in this case. 



Remark 4: As we will see in Section VIII same outer-bounds hold for the scenario in which output feedback 
links are available from each receiver to both transmitters, see Figure [3jb). Therefore, the capacity region of two- 
user binary IC with Delayed-CSIT and output feedback links are available from each receiver to both transmitters. 



is the same as the capacity region described in (12). 

Finally, we present our result for the case of Instantaneous-CSIT and output feedback. Note that in this scenario, 
although transmitters have instantaneous knowledge of the channel state information, the output signals are available 
at the transmitters with unit delay. This scenario corresponds to a slow-fading channel where output feedback links 
are available from the receivers to the transmitters. 

Theorem 4: [Capacity Region with Instantaneous-CSIT and OFB] For the two-user binary IC with Instantaneous- 
CSIT and OFB, the capacity region ^icsit.ofb^ ^ ^^^^ tuples {R\,R'2) satisfying 



ICSIT,OFB 



< fli < 1 - g2, 

-Ri + < 1 - + vq- 



1,2, 



(13) 



Remark 5: Comparing the capacity region of the two-user BFIC with Instantaneous-CSIT, with OFB (13 1 or 



without OFB (10 1, we observe that the outer-bound on the sum-rate remains unchanged. However, the bounds on 
individual rates are further increased to 1 — q^. Similar to the previous remark, this is again due to the additional 
communication path provided by OFB from each transmitter to its intended receiver. However, since the outer- 



bound on sum-rate with Instantaneous-CSIT and OFB ( 13 1 is higher than that of Delayed-CSIT and OFB ( 12 1, the 
bounds on individual rates cannot be eliminated. 

The proof of the results is organized as follows. The proof of Theorem |2] is presented in Sections |V] and VI 



The proof of Theorem [3] is presented in Sections VII and |VIII[ and finally, the proof of Theorem |4] is presented in 
Sections llX] and |X] We end this section by illustrating our main results via an example in which p = 0.5. 



C. Illustration of Main Results for p = 0.5 

For this particular value of the channel parameter, the capacity region with Delayed-CSIT and Instantaneous- 
CSIT with or without output feedback is given in Table |lj and Figure [4] illustrates the results presented in this table. 
We notice the following remarks. 

TABLE I 

Illustration of our main results through an example in which p = 0.5. 





Capacity Region 


Capacity Region 




with Delayed-CSIT 


witli Instantaneous-CSIT 


No-OFB 


< 


Ri + < 8 




OFB 


\ 


Rl + |i?2 1 
fi?l+i?2 < f 


\ i?i + i?2 < 1 



Remark 6: Note that for p = 0.5, we have 

(^No-CSIT ^ j^DCSIT ^ j^ICSIT 
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In other words, the capacity region with Instantaneous-CSIT is strictly larger than that of Delayed-CSIT, which 
is in turn strictly larger than the capacity region with No-CSIT. Moreover, we have 

^DCSIT,OFB ^ j^ICSIT.OFB 

meaning that the instantaneous knowledge of the CSIT enlarges the capacity region of the two-user BFIC with 
OFB compared to the case of Delayed-CSIT. 




72 R2 Vl % R2 72 74 R2 

(a) (b) (c) 



Fig. 4. Two-user Binary Fading IC: (a) the capacity region with No-CSIT, Delayed-CSIT, and Instantaneous-CSIT, without OFB; (6) the 
capacity region with No-CSIT, Delayed-CSIT, and Instantaneous-CSIT, with OFB; and (c) the capacity region with Delayed-CSIT, with and 
without output feedback. 

Remark 7: In Figure |4jc), we have illustrated the capacity region with Delayed-CSIT, with and without output 
feedback. First, we observe that OFB enlarges the capacity region. Second, we observe that the optimal sum-rate 
point is the same for p = 0.5. However, this is not always the case. In fact, for some values of p, output feedback can 
even increase the optimal sum-rate. Using the results of Theorem |2] and Theorem [3j we have plotted the sum-rate 
capacity of the two-user Binary Fading IC with and without OFB for the Delayed-CSIT model in Figure [5] Note 
that for < p < (3 — 1/5) /2, the sum-rate capacity with OFB is strictly larger than the no OFB scenario. 




Fig. 5. The sum-rate capacity of tiie two-user BFIC with Delayed-CSIT, with and without output feedbaclc. For < p < (3 — \/5) /2, the 
sum-rate capacity with OFB is strictly larger than the scenario where no OFB is available. 



Remark 8: Comparing the capacity region of the two-user BFIC with Instantaneous-CSIT, with OFB (13 1 or 



without OFB (10 1, we observe that OFB enlarges the capacity region. Moreover, similar to the Delayed-CSIT 
scenario, the optimal sum-rate point is the same for p = 0.5. Again, this is not always the case. In fact, for 
< p < 0.5, output feedback can even increase the optimal sum-rate. Using the results of Theorem [T] and 
Theorem |4} we have plotted the sum-rate capacity of the two-user Binary Fading IC with and without OFB in 
Figure [6] 
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Fig. 6. The sum-rate capacity of tiie two-user BFIC with Instantaneous-CSIT, with and without output feedbaclc. For < p < 0.5, the 
sum-rate capacity with OFB is strictly larger than the scenario where no OFB is available. 



Remark 9: In Figures |5] and [6j we have identified the range of p for which output feedback provides sum-rate 
gain. Basically, when the sum-rate capacity without OFB is dominated by the capacity of the direct links {i.e. 2p), 
and the additional communication paths created by the means of output feedback links help increase the optimal 
sum-rate. 

In the following section, we present the main ideas that we incorporate in this paper. 

IV. Overview of Key Ideas 

Our goal in this section is to present the key techniques we use in this paper both for achievability and converse 
purposes. Although we will provide detailed explanation of the achievability strategy and converse proofs for all 
different scenarios, we found it instructive to elaborate the main ideas through several clarifying examples. In 
particular, for the sake of achievability, we show how Delayed-CSIT and later, Delayed-CSIT plus output feedback 
can help us improve the achievable rate region. Then, we present a key lemma that our converse proofs with 
Delayed-CSIT are based on. 

A. Achievability Ideas with Delayed-CSIT 

As we have described in Section |ll| the channel gains are independent from each other and over time. This 
way, transmitters cannot use the delayed knowledge of the channel state information to predict future. However, 
this information can still be very useful. In particular, Delayed-CSIT allows us to evaluate the contributions of 
the desired signal and the interference at each receiver in the past signaling stages and exploit it as available side 
information for future communication. 

I ) Interference-free Bits: Using Delayed-CSIT transmitters can identify previously transmitted bits such that if 
retransmitted, they do not create any further interference. The following examples clarify this idea. 

Example 1 [Creating interference channels with side information]: Suppose at a time instant, each one of the 
transmitters simultaneously sends one data bit. The bits of Txi and Tx2 are denoted by ai and hi respectively. 
Later, using Delayed-CSIT, transmitters figure out that only the cross links were equal to 1 at this time instant 
as shown in Figure |7]^a). This means that in future, transmission of these bits will no longer create interference 
at the unintended receivers. In other words, these bits can be transferred to a sub-problem, where in a two-user 
interference channel, Rxj has apriori access to Wj, i = 1,2. Since there will be no interference in this sub-problem, 
such bits can be communicated at higher rates. 

Example 2 [Creating interference channels with swapped receivers and side information] : Assume that at a time 
instant, transmitters one and two simultaneously send data bits, say a2 and 62 respectively. Again through Delayed- 
CSIT, transmitters realize that all links except the link between Txi and Rx2 were equal to 1, see Figure |7jb). 
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(a) (b) (c) 

Fig. 7. Achiev ability ideas with Delayed-CSIT: (a) via Delayed-CSIT transmitters can figure out which bits are already known at the 
unintended receivers, transmission of these bits will no longer create interference at the unintended receivers; and (b) to decode the bits, 
it is sufficient that Tx2 provides Rxi with 62 while this bit is available at Rx2; (c) similar to (6). Note that in (b) and (c) the intended 
receivers are swapped. 

In a similar case, assume that at another time instant, transmitters one and two send data bits 03 and 63 at the 
same time. Through Delayed-CSIT, transmitters realize that all links except the link between Tx2 and Rxi were 
connected, see Figure [TJc). Then it is easy to see that to successfully finish delivering these bits, it is enough that 
Txi sends 03 to Rx2, while this bit is already available at Rxi; and Tx2 sends 62 to Rxi, while it is already available 
at Rx2. Therefore, again this problem can be evaluated as an interference channel with side information, where the 
intended receivers are swapped. 

Remark 10: As described in Examples 1 and 2, an interference free bit can be retransmitted without worrying 
about creating interference at the unintended receiver. For instance consider Example 1, since the bits at Txj are 
already available at Rx^, the transmitters can transfer such bits to an interference channel with side information as 
depicted in Figure [8] We note that for this new problem, the capacity region with no, delayed, or instantaneous 
CSIT is the same. 

I W2 




I Wi 

Fig. 8. Interference channel with side information: the capacity region with no, delayed, or instantaneous CSIT is the same. 

2) Bits of Common Interest: Transmitters can use the delayed knowledge of the channel state information to 
identify bits that are of interest of both receivers. Below, we clarify this idea through several examples. 

Example 3 [Opportunistic creation of bits of common interest]: Suppose at a time instant, each one of the 
transmitters sends one data bit, say 04 and 64 respectively. Later, using Delayed-CSIT, transmitters figure out that 
all links were equal to 1. In this case, both receivers have an equation of the transmitted bits, see Figure |9ja). 
Now, we notice that it is sufficient to provide either of the transmitted bits, 04 or 64, to both receivers rather 
than retransmitting both bits. We refer to such bits as bits of common interest. Since such bits are useful for both 
receivers, they can be transmitted more efficiently. 

Remark 11 (Pairing bits of common interest to create a two-multicast problem): We note that in Example 3, one 
of the transmitters takes the responsibility of delivering one bit of common interest to both receivers. While this 
scheme improves the rate region, it is still not the most efficient scheme. The reason is that during the transmission, 
one of the transmitters stays silent and therefore the outgoing links of that transmitter are not utilized. To improve 
this, we can pair this problem with another similar problem as follows. Assume that in another time instant, each 
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Rxi 

• a4 ® b4 



• a4 © b4 

RX2 




Rxi 



RX2 



(a) 



(b) 



Fig. 9. In each case, it is sufficient to provide only one of the transmitted bits to both receivers. We refer to such bits as bits of common 
interest. 



one of the transmitters sends one data bit, say 05 and 65 respectively. Later, transmitters figure out that all links 
were equal to 1, see Figure |9jb). In this case, similar to Example 3, one of the bits 05 and 65, say 65, can be 
chosen as the bit of common interest. Now we can pair cases depicted in Figures |9j a) and|9jb). Then transmitters 
can simultaneously send bits 04 and 65, to both receivers. In this case, both bits 04 and 65 are needed by both 
receivers. In addition, we take advantage of all four links to transmit information, which improves the rate region. 

Remark 12 (Pairing ICs with side information to create a two-multicast problem (pairing Type-I)): The advan- 
tage of interference channels with side information, explained in Examples 1 and 2, is that due to the side 
information, there is no interference involved in the problem. The downside is that half of the links in the channel 
become irrelevant and unexploited. More precisely, the cross links in Example 1 and the direct links in Example 2 
are not utilized to increase the rate. Here we show that these two problems can be paired together to form an 
efficient two-multicast problem through creating bits of common interest. Referring to Figure |7} one can easily 
verify that it is enough to deliver ai © as and bi © 62 to both receivers. For instance, if oi © as and bi © 62 are 
available at Rxi, it can remove bi from bi © 62 to decode 62, then using 62 and a2 © 62 it can decode 02; finally, 
using as and ai © as it can decode ai. Indeed, bit ai © as available at Txi, and bit bi © &2 available at Tx2, are bits 
of common interest and can be transmitted to both receivers simultaneously in the efficient two-multicast problem 



as depicted in Figure 10 We note that for the two-multicast problem, the capacity region with no, delayed, or 
instantaneous CSIT is the same. We shall refer to this pairing as pairing Type-I throughout the paper. 




Fig. 10. Two-multicast network. Transmitter Txi wishes to reliably communicate message Wi to both receivers, i — 1,2. The capacity 
region with no, delayed, or instantaneous CSIT is the same. 

Example 4 [Pairing interference-free bits with bits of common interest to create a two-multicast problem (pairing 
Type-II)]: Suppose at a time instant, each one of the transmitters sends one data bit, say ag and b^ respectively. 



Later, using Delayed-CSIT, transmitters figure out that all links were equal to 1, see Figure ILa). In another time 
instant, each one of the transmitters sends one data bit, say a-j and 67 respectively. Later, transmitters figure out 
that only the cross links were equal to 1, see Figure [TTJb). Now, we observe that providing oe © aj and ftg © 
to both receivers is sufficient to decode the bits. For instance if Rxi is provided with ag © a-j and b^ © 67, then it 
will use 67 to decode b^, from which it can obtain ae, and finally using ag and og © a7, it can decode 07. Thus, 
bit as © a7 available at Txi, and bit b^ © 67 available at Tx2, are bits of common interest and can be transmitted 
to both receivers simultaneously in the efficient two-multicast problem. We shall refer to this pairing as pairing 
Type-II throughout the paper. 

Example 5 [Pairing bits of common interest with interference-free bits with swapped receivers to create a two- 
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(a) (b) 

Fig. 11. Pairing Type-II: providing ag © 07 and fog ® 67 to both receivers is sufficient to decode the bits. In other words, bit ae ® 07 
available at Txi, and bit be ® br available at Tx2, are bits of common interest and can be transmitted to both receivers simultaneously in 
the efficient two-multicast problem. Note that in (6), the cross links would have been irrelevant for future communications, however, using 
this pairing, we exploit all links. 



multicast problem (pairing Type-Ill)]: Suppose at a time instant, each one of the transmitters sends one data bit, 
say ag and respectively. Later, using Delayed-CSIT, transmitters figure out that all links were equal to 1 as in 
Figure 12 a). In another time instant, each one of transmitters sends one data bit, say ag and 69 respectively. Later, 
transmitters figure out that all links were equal to 1 except the link from Tx2 to Rxi, see Figure [T2]^b). In a similar 
case, assume that at another time instant, transmitters one and two send data bits oio and 610 at the same time. 
Through Delayed-CSIT, transmitters realize that all links except the link between Txi and Rx2 were connected, see 
Figure [T2|^c). We observe that providing ag ® ag and 63 ® 610 to both receivers is sufficient to decode the bits. For 
instance, if Rxi is provided with ag © ag and feg ® 610, then it will use ag to decode ag, from which it can obtain 
6g, then using 63 and h% © 610, it gains access to 610, finally using 610, it can decode aio from aio ® 6io- Thus, 
bit ag © ag available at Txi, and bit 6g © 610 available at Tx2, are bits of common interest and can be transmitted 
to both receivers simultaneously in the efficient two-multicast problem. We shall refer to this pairing as pairing 
Type-Ill throughout the paper. 



Txi Rxj Txi Rxi Txi Rxj 




TX2 RX2 TX2 RX2 TX2 Rx2 

(a) (b) (c) 



Fig. 12. Pairing Type-Ill: providing ag ag and bg © 610 to both receivers is sufficient to decode the bits. In other words, bit ag © ag 
available at Txi, and bit bs © 610 available at Tx2, are bits of common interest and can be transmitted to both receivers simultaneously in 
the efficient two-multicast problem. 

As explained in the above examples, there are several ways to exploit the available side information at each 
transmitter. To achieve the capacity region, the first challenge is to evaluate various options and choose the most 
efficient one. The second challenge is that different opportunities may occur with different probabilities. This makes 
the process of matching, combining, and upgrading the status of the bits very difficult. Unfortunately, there is no 
simple guideline to decide when to search for the most efficient combination of the opportunities and when to hold 
on to other schemes. It is also important to note that most of the opportunities we observe here, do not appear in 
achieving the DoF of the Gaussian multi-antenna interference channels (see e.g., |[5|, Q). 

B. Achievability Ideas with Output Feedback 

In this subsection, we focus on the impact of the output feedback in the presence of Delayed-CSIT The first 
observation is that through output feedback, each transmitter can evaluate the interference of the other transmitter, 
and therefore has access to the previously transmitted signal of the other user. Thus, output feedback can create 
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new path of communication between each transmitter and the corresponding receiver, e.g., 

Txi — )• Rx2 — )• Tx2 — )• Rxi. 

Although this additional path can improve the rate region, the advantage of output feedback is not limited to 
that. We explain the new opportunities through two examples 

Example 6 [Creating two-multicast problem from ICs with side information]: In the previous subsection, we 
showed that interference-free transmissions can be upgraded to two-multicast problems through pairing. However, 
it is important to note that the different channel realizations used for pairing do not occur at the same probability. 
Therefore, it is not always possible to fully implement pairing in all cases. In particular, in some cases, some 
interference-free transmissions are left alone without possibility of pairing. In this example, we show that output 
feedback allows us to create bits of common interest out of these cases, which in turn allows us to create two- 
multicast problems. Referring to Figure [13] one can see that through the output feedback links, transmitters one 
and two can learn bu and an respectively. Therefore, either of the transmitters is able to create an © ^n. It is 
easy to see that an ® bu is of interest of both receivers. Indeed, feedback allows us to form a bit of common 
interest which can be delivered through the efficient two-multicast problem. 




Fig. 13. Opportunistic creation of bits of common interest using output feedback: bit bu is available at Txi via the feedback link from 
Rxi; it is sufficient that Txi provides an © fcn to both receivers. 

Example 7 [Creating two-multicast problem from ICs with swapped receivers and side information] : As another 
example, consider the two channel gain realizations depicted in Figure [14] In these cases, using output feedback 
Txi can learn the transmitted bit of Tx2 {i.e. bi2), and then form ai3 © bi2. It is easy to see that ai3 © 612 is useful 
for both receivers and thus is a bit of common interest. Similar argument is valid for the second receiver. This 
means that output feedback allows us to upgrade interference-free transmissions with swapped receivers to bits of 
common interest that can be used to form efficient two-multicast problems. 




Fig. 14. Opportunistic creation of bits of common interest using output feedback: using output feedback Txi can learn the transmitted bit 
o/Tx2 (i.e. fei2j,' now, we observe that providing ais © &12 to both receivers is sufficient to decode the intended bits. 



C. Key Idea for Converse Proofs with Delayed-CSIT 

While we provide detailed proofs in Sections VI and VIII we try to describe the main challenge in deriving the 
outer-bounds in this subsection. Consider the Delayed-CSIT scenario and suppose rate tuple i?2) is achievable. 
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Then for /3 > 0, we have 



n + (3R2) = H{Wi\W2, G") + /3F(W2|G") 

(Fano) 



(14) 



We refer the reader to Section VI for the detailed derivation of each step. Here, we would like to find a value 
of P such that 



i?(G'|'iXi"|G") - /3F(G5'2^riG'") < 0, 



(15) 



for any input distribution. Note that since the terms involved are only a function of and the channel gains, 
this term resembles a broadcast channel fromed by Txi and the two receivers. Therefore, the main challenge boils 
down to understanding the ratio of the entropies of the received signals in a broadcast channel, and this would be 
the main focus of this subsection. 




Fig. 15. A transmitter connected to two receivers througii binary fading ciiannels. 

Consider a transmitter that is connected to two receivers through binary fading channels as depicted in Figure [15] 
We would like to understand how much this transmitter can privilege receiver one to receiver two, given outdated 
knowledge of the channel state information. Our metric would be the ratio of the entropies of the received signal^ 
In other words, we would like to understand what is the lower-bound on the ratio of the entropy of the received 
signal at Rx2 to that of Rxi. We first point out the result for the No-CSIT and Instantaneous-CSIT cases. With 
No-CSIT, from transmitter's point of view the two receivers are identical and it cannot favor one over the other 
and as a result, the two entropies would be equal. However with Instantaneous-CSIT, transmitter can choose to 
transmit at time t only if Gi [t] = 1 and G2 [t] = 0. Thus, with Instantaneous-CSIT the ratio of interest could be as 



low as 0. For the Delayed-CSIT case, we have the following lemma which we will formally prove in Section VI 
Here, we try to provide some intuition about the problem by describing an input distribution that utilizes delayed 
knowledge of the channel state information in order to favor receiver one. It is important to keep in mind that this 
should not be considered as a proof but rather just a helpful intuition. Also, we point out that for the two-user 



BFIC with Delayed-CSIT and OFB, we will derive a variation of this lemma in Section VIII 

Lemma 1: [Entropy Leakage] For the channel described above with Delayed-CSIT, and for any input distribu- 
tion, we have 

H{Y^\G'') > ^^if (yi"|G") . (16) 

As mentioned before, we do not intend to prove this lemma here. We only provide an input distribution for which 
this lower-bound is tight. Consider m bits drawn from i.i.d. Bernoulli 0.5 random variables and assume these bits 
are in some initial queue. At any time instant t, the transmitter sends one of the bits in this initial queue (if the 
queue is empty, then the scheme is terminated). At time instant t + I, using Delayed-CSIT, the transmitter knows 
which one of the four possible channel realizations depicted in Figure [16] has occurred at time t. If either of the 
realizations (a) or (6) occurred at time t, then we remove the transmitted bit from the initial queue. However, if 
either of the realizations (c) or (d) occurred at time t, we leave this bit in the initial queue (i.e. among the bits that 

^We point out that if H{GiiXi\G") = 0, then ratio is not defined. But we keep in mind that what we really care about is |l5| . 
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Rxi Rxi Rxi Rxi 




RX2 RX2 RX2 RX2 

(a) (b) (c) (d) 

Fig. 16. Four possible channel realizations for the network in Figure [75] The transmitter sends out a data bit at time instant t, and at the 
next time instant, using Delayed-CSIT, he knows which channel realization has occurred. If either of the realizations (a) or (b) occurred at 
time t, then we remove the transmitted bit from the initial queue. However, if either of the realizations (c) or (d) occurred at time t, we 
leave this bit in the initial queue. This way the transmitter favors receiver one over receiver two. 



can be transmitted at any future time instant). Note that this way, any bit that is available at Rx2 would be available 
at Rxi, however, there will be bits that are only available at Rxi. Hence, the transmitter has favored receiver one 
over receiver two. If we analyze this scheme, we get 

1 — a 



h{y:^\g'') 



(17) 



meaning that the bound given in ( [16] ) is achievable and thus, it is tight. 

Now that we have described the key ideas we incorporate in this paper, starting next section, we provide the 
proof of our main results. 



V. ACHIEVABILITY PROOF OF THE0REm[2] [DELAYED-CSIT] 



For < p < (3 — V 5) /2, the capacity of the two-user BFIC with Delayed-CSIT is depicted in Figure 17 a) and 
as a result, it is sufficient to describe the achievability for point A = {p,p). However, for (3 — \/5) /2 < p < 1, 
all bounds are active and the region, as depicted in Figure [TTJb), is the convex hull of points A, B, and C. By 
symmetry, it is sufficient to describe the achievability for points A and C in this regime. 

We first provide the achievability proof of point A for 0.5 < p < 1 in this section. Then, we provide an 
overview of the achievability proof of corner point C and we postpone the detailed proof to Appendix |D] Finally 
in Appendix ]C] we present the achievability proof of point ^4 for < p < 0.5. 



Ri 



(a) 



R2 




Fig. 17. Capacity Region of the two-user Binary Fading IC with Delayed-CSIT for: (a) < p < (3 — \/5) /2; and (b) (3 — \/5) /2 < 
p < 1. 
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TABLE n 

All possible channel realizations and transitions from the initial queue to other queues; solid arrow from 

TRANMSITTER Tx, TO RECEIVER Rxj INDICATES THAT Gij[t] = 1, i, j € {1,2}, t = 1, 2, . . . ,n. BIT "a" REPRESENTS A BIT IN Qi^i 

WHILE BIT "b" REPRESENTS A BIT IN Q2^2- 



case ID 


channel realization 
at time instant n 


State transition 


case ID 


channel realization 
at time instant n 


state transition 


1 


a 

>< 




J a ^ Qi.Ci 

1 & ^ Q2,Ci 


9 


Txi Rxi 

a • • 

b m h 




( a ^ Qi^i 
\ Q2^F 




Txj Rxj 


2 


a >• a 


] 


a — ^ Q\^2\\ 

, & ^ Q2,F 


10 


Txi Rxi 

a • h 
h 9^ >• b 




J a — !> Qi^i 

\ b^ Q2^F 


h m — »• a + ft 


Tx^ Rx^ 


3 


Txi Rx, 

a • a + i) 

h h 


\ 


a Qi^F 

. fe Q2^1|2 


11 


Txi Rxi 

a • 

b 9 a^b 


{ 


a — ^ Qi^{i,2} 

b Q2,F 


Tx. Rx. 


Tx^ Rx^ 


4 


Txi Rxi 




r a ^ Qi^F 

I fe ^ Q2^F 


12 


Txi Rxi 


{ 


a — ^ Qi^{i,2} 

b Q2,F 


h m ■ — >• h 

Tx. Rx. 


Tx^ Rx^ 


5 


Txi Rxi 

b • • 

Tx. Rx. 




r a — ^ Qi^F 

1 6 Q2^2 


13 


Txi Rxi 

b 9^ • 

Tx^ Rxj 


< 


a Qi^i 

. b Q2^2\l 


6 


Txi Rxi 

b 9^^^^^^^^^^^ a 

Txj Rx, 




r a — ^ Qi^F 
\ b ^ Q2^2 


14 


Txi Rxi 

b • 

Txj Rxj 


\ 


a (5i^i|2 

_ b Q2^2 


7 


Txi Rxi 

b W''^^^^^^^ • 

Txj Rx. 


{ 


a — Qi.F 

6 — ^ (32^{l,2} 


15 


Txi Rxi 
Tx^ Rx^ 


\ 


a (5i^i|2 

. b (52^2|l 


8 


Tx| Rx| 
Tx. Rx. 


{ 


a -> Qi,F 

& -> <32^{l,2} 


16 


Txi Rxi 

a • • 

J) • • 

Txi Rxj 




J a — ^ Qi-^i 
1 b Q2^2 



A. Achievability Strategy for Corner Point A 

In this subsection, we describe a transmission strategy that achieves a rate tuple arbitrary close to comer point 
A for 0.5 < p < 1 as depicted in Figure [TTj^b), i.e. 

1 + (1 — g^j 

Let the messages of transmitters one and two be denoted by Wi = ai, 02, • • • , am, and W2 = 61, • • • > bm, 
respectively, where data bits Oj's and 6j's are picked uniformly and independently from {0, 1}, z = 1, . . . , m. We 
show that it is possible to communicate these bits in 

n = (I - q"^)'^ m + (l - q'^y'^ pm + O (m^^^) (19) 



time instant^ with vanishing error probability (as m — )• cxd). Therefore achieving the rates given in ( 18 1 as m — )• 00. 
Our transmission strategy consists of two phases as described below. 

Phase 1 [uncategorized transmission]: At the beginning of the communication block, we assume that the bits at 
Txj are in queue Qi^i (the initial state of the bits), i = 1, 2. At each time instant t, Txj sends out a bit from Qi^i, 

'Throughout the paper whenever we state the number of bits or time instants, say n, if the expression for a given value of p is not an 
integer, then we use the ceiling of that number \n], where [.] is the smallest integer greater than or equal to n. Note that since we will 
take the limit as m — > 00, this does not change the end results. 
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and this bit will either stay in the initial queue or transition to one of the following possible queues will take place 
according to the description in Table [ll] If at time instant t, Qi^i is empty, then Txj, i = 1, 2, remains silent until 
the end of Phase 1 . 

(A) Qi,Ci- The bits that at the time of communication, all channel gains were equal to 1. 

(B) Qi^{i^2y- The bits that are of common interest of both receivers and do not fall in category (A). 

(C) The bits that are required by Rxj but are available at the unintended receiver Rxj. A bit is in Qi^i\i 
if Rx- gets it without interference and Rxj does not get it with or without interference. 

(D) The bits that are required by Rx^ but are available at the intended receiver Rxj. More precisely, a bit 
is in Qi^i\i if Rxj gets the bit without interference and Rxj gets it with interference. 

(E) Qi^F- The bits that we consider delivered and no retransmission is required. 

More precisely, based on the channel realizations, a total of 16 possible configurations may occur at any time 
instant as summarized in Table |IT1 The transition for each one of the channel realizations is as follows. 

• Case 1 ( X ) : If at time instant t, Case 1 occurs, then each receiver gets a linear combination of the bits that 



were transmitted. Then as illustrated in Figure 18 if either of such bits is provided to both receivers then the 
receivers can decode both bits. The transmitted bit of Txj leaves Qi-^i and joins (5j,Ci|^ i = 2. Although 
we can consider such bits as bits of common interest, we keep them in an intermediate queue for now and as 
we describe later, we combine them with other bits to create bits of common interest. 




Fig. 18. Suppose transmitters one and two send out data bits a and b respectively and Case 1 occurs. Now, if either of the transmitted bits 
is provided to both receivers, then each receiver can decode its corresponding bit. 

• Case 2 : In this case, Rxi has already received its corresponding bit while Rx2 has a linear combination 
of the transmitted bits, see Table [lH As a result, if the transmitted bit of Txi is provided to Rx2, it will be 
able to decode both bits. In other words, the transmitted bit from Txi is available at Rxi and is required 
by Rx2. Therefore, transmitted bit of Txi leaves Qi^i and joins Qi_^2|i- Note that the bit of Tx2 will 
not be retransmitted since upon delivery of the bit of Txi, Rx2 can decode its corresponding bit. Since no 
retransmission is required, the bit of Tx2 leaves Q2^2 and joins Q2,f (the final state of the bits). 

• Case 3 (^^^ '■ This is similar to Case 2 with swapping user IDs. 

• Case 4 : In this case, each receiver gets its corresponding bit without any interference. We consider such 
bits to be delivered and no retransmission is required. Therefore, the transmitted bit of Txj leaves Qi^i and 
joins Qi^F, i = l,2. 

• Case 5 (~^) and Case 6 (^): In these cases, Rxi gets its corresponding bit interference free. We consider this 
bit to be delivered and no retransmission is required. Therefore, the transmitted bit of Txi leaves Qi^i and 
joins Qi^F, while the transmitted bit of Tx2 remains in (52-s>2- 

• Case 7 (7^): In this case, Rxi has a linear combination of the transmitted bits, while Rx2 has not received 
anything, see Table |ll] It is sufficient to provide the transmitted bit of Tx2 to both receivers. Therefore, the 
transmitted bit of Tx2 leaves Q2^2 and joins Q2^{i,2}- Note that the bit of Txi will not be retransmitted 
since upon delivery of the bit of Tx2, Rxi can decode its corresponding bit. This bit leaves Qi-^i and joins 
Qi^F- Similar argument holds for Case 8 (^). 

''in this paper, we assume that the queues are ordered. Meaning that the first bit that joins the queue is placed at the head of the queue 
and any new bit occupies the next empty position. For instance, suppose there are £ bits in Qi.Ci and £ bits in Q2,Ci, then the next time 
Case 1 occurs, the transmitted bit of Txi is placed at position ^ + 1 in Qi,Ci, i — 1,2. 
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• Cases 9,10,11, and 12: Similar to Cases 5,6,7, and 8 with swapping user IDs respectively. 

• Case 13 (/^): In this case, Rxi has received the transmitted bit of Tx2 while Rx2 has not received anything, see 
Table [ill Therefore, the transmitted bit of Txi remains in Qi^^i, while the transmitted bit of Tx2 is required 
by Rx2 and it is available at Rxi. Hence, the transmitted bit of Tx2 leaves Q2->2 and joins Q2^2|i- Queue 
Q2->2|i represents the bits at Tx2 that are available at Rxi, but Rx2 needs them. 

• Case 14 (\): This is similar to Case 13 with swapping user IDs. 

• Case 15 (>5): In this case, Rxi has received the transmitted bit of Tx2 while Rx2 has received the transmitted 
bit of Txi, see Table [ill other words, the transmitted bit of Tx2 is available at Rxi and is required by Rx2; 
while the transmitted bit of Txi is available at Rx2 and is required by Rxi . Therefore, we have transition from 
Qi^i to Qi^i\i, i = l,2. 

• Case 16: The transmitted bit of Txj remains in Qi^i, i = 1,2. 
Phase 1 goes on for 

(l - g2)-^m, + mt (20) 

time instants, and if at the end of this phase, either of the queues Qi^i is not empty, we declare error type-I and 
halt the transmission (we assume m is chosen such that ma G Z). 

Assuming that the transmission is not halted, let Ni^Ci, N^^j^j, and A^j^ji 2} denote the number of bits in queues 
Qi,Ci> Qi~^j\~j^ and Qi^{i^2} respectively at the end of the transitions, i = 1,2, and j = i, i. The transmission strategy 
will be halted and an error type-II will occur, if any of the following events happens. 

2 A 

Ni^jfj > HNi^jfj] + ma = ni^j\j, i = l,2, and j = i, i; 

iV,^|i,2} > E[Ar^^|i,2}] + mi = ni^|i,2}, i = 1,2. (21) 
From basic probability, we know that 



Pr (Case 2) 
Ei=9,io,i3,i6P'^(Case i) 



y^.-n 19 Pr (Case j) „ , „ 

m.^{i,2}] = 1 y'-'''' PHcln "^ = (1 - I'rVi^- (22) 

-L - 2^1=9,10,13,16 I'^ase 1; 

Furthermore, we can show that the probability of errors of types I and II decreases exponentially with m. More 
precisely, we use Chemoff-Hoeffding bouncQ to bound the error probabilities of types I and II. For instance, to 
bound the probability of error type-I, we have 

2 

Pr [error type — I] < Pr [Qi^i is not empty] 



1=1 

..,4/3 

< 4 exp 




4(1 — (1 — q^) m + ma 



(23) 



^We consider a specific form of tlie Cfiemoff-Hoeffding bound (2l( described in (22) , which is simpler to use and is as follows. If 
Xi, . . . , Xr are r independent random variables, and M = X^^^i Xi, then Pr [\M — E [M] | > a] < 2 exp ^ 4^r ~var(x ) 
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which decreases exponentially to zero as m — oo. 

At the end of Phase 1, we add O's (if necessary) in order to make queues Qi,Ci> Qi^j\j 



, and Qi 



of size 



equal to nj Ci> n^^j^j, and 2} respectively as defined in (21 1, i = 1,2, and j = For the rest of this 

subsection, we assume that Phase 1 is completed and no error has occurred. 

We now use the ideas described in Section IV-A to further create bits of common interest. Depending on the 
value of p, we use different ideas. We break the rest of this subsection into two parts: (1) 0.5 < p < (\/5 — l) /2; 
and (2) (-v/5 — l) /2 < p < 1. In what follows, we first describe the rest of the achievability strategy for 0.5 < p < 



IV-A to create bits of common 



^5 — 1) /2. In particular, we demonstrate how to incorporate the ideas of Section 
interest in an optimal way. 

• Type I Combining bits in Qi^^i and Qi^ifi' Consider the bits that were transmitted in Cases 2 and 14, see 
Figure 19 Observe that if we provide ai © 02 to both receivers then Rxi can decode bits ai and 02, whereas 
Rx2 can decode bit bi. Therefore, ai ® 02 is a bit of common interest and can join (5i_s>{i,2}- Hence, as 
illustrated in Figure 20 we can remove two bits in (5i-5>2|i ^nd Qi^i\2, by inserting their XOR in Qi-i.{i,2}> 
and we deliver this bit of common interest to both receivers during the second phase. Note that due to the 
symmetry of the channel, similar argument holds for (52^i|2 ^^d Q2^2\i- 




Fig. 19. Suppose at a time instant, transmitters one and two send out data bits ai and 61 respectively, and later using Delayed-CSIT, 
transmitters figure out Case 2 occurred at that time. At another time instant, suppose transmitters one and two send out data bits 02 and 62 
respectively, and later using Delayed-CSIT, transmitters figure out Case 14 occurred at that time. Now, bit ai ©02 available at Txi is useful 
for both receivers and it is a bit of common interest. Hence, ai ® a2 can join (5i^{i,2}. 



Ql^2 


1 




as 


a2 


ai 


Qi^i 


2 




as 


a2 


ai 



Ql^2|1 0Ql^1|2 



32 32 



3l ® 3i 



Fig. 20. Creating XOR of the bits in two different queues. We pick one bit from each queue and create the XOR of the two bits. 

< E[A^,^,it1. Therefore, after this combination, queue Qi^j^i 



For 0.5 < p < {V5 - 1) /2, we have E[Ni_ 
becomes empty and we have 



n\i\ 



(24) 



bits left in Qi^^nj. 

Type II Combining the bits in Qi^Ci and Qi^i\i- Consider the bits that were transmitted in Cases 1 and 15, 
see Figure 21 It is easy to see that providing ai © 02 and bi © 62 to both receivers is sufficient to decode 
their corresponding bits. For instance, Rxi removes 62 from bi © 62 to decode 61 , then uses 61 to decode ai 
from fli © 61. Therefore, oi © 02 and bi © 62 are bits of common interest and can join Qi^{i^2} and (32->{i,2} 
respectively. Hence, we can remove two bits in Qi,Ci and Qi^i\i, by inserting their XOR in Qi^{i,2}> ^ = 1> 2, 
and then deliver this bit of common interest to both receivers during the second phase. 
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Fig. 21. Suppose at a time instant, transmitters one and two send out data bits ai and 61 respectively, and later using Delayed-CSIT, 
transmitters figure out Case 1 occurred at that time. At another time instant, suppose transmitters one and two send out data bits 02 and 62 
respectively, and later using Delayed-CSIT, transmitters figure out Case 15 occurred at that time. Now, bit ai ® 02 available at Txi and bit 
61 ® 62 available at Tx2 are useful for both receivers and they are bits of common interest. Therefore, bits ai ® 02 and 61 ® 62 can join 
<3i^{i,2} and Q2^{i,2} respectively. 



For 0.5 < p < {V5 - 1) /2, we have pq — p^) < E[A^j cj- Therefore after combining the bits, queue Qi^i\i 
becomes empty and we have 

K[iVi,cJ + mi - {^[N^^4 - =p{p-q) + ml (25) 

bits left in (5i,Ci> i = 1,2. 

2 

Finally, we need to describe what happens to the remaining p{p — q) + ms bits in (5i,Ci- As mentioned before, 
a bit in Qj.Ci can be viewed as a bit of common interest by itself. For the remaining bits in Qi,Ci, we put the first 
half in (5i-s.{i,2} (suppose m is picked such that the remaining number of bits is even). Note that if these bits are 
delivered to Rx2, then Rx2 can decode the first half of the remaining bits in (52, Ci as well. Therefore, the first half 
of the bits in (52, Ci can join (52,F- 

Then, we put the second half of the remaining bits in (52, Ci in (52->{i,2}- Similar to the argument presented 
above, the second half of the bits in (5i,Ci join Qi.F- 

Hence at the end of Phase 1, if the transmission is not halted, we have a total of 



{1-q 



2\ 



p'^q + m^/^ + pq'^ + m^/^ +0.5 {p'^ - pq^ + p^q + m^/^) 



m 



Cases 11 and 12 XOR opportunities remaining Case 1 

= {l-q^y^ 0.5pm + 2.5m^l-' (26) 

number of bits in (5i->{i,2}- Same result holds for (52^{i,2}- 

This completes the description of Phase 1 for 0.5 <p< (\/5 — l) /2. For (-y/S — l) /2 < p < 1, we combine 
the bits as follows. Fot this range of p, after Phase 1, the number of bits in each queue is such that the mergings 
described above are not optimal and we have to rearrange them as decsribed below. 

• Type I Combining Qi^-^^i and Qi^i\^i. We have already described this opportunity for 0.5 < p < [^/5 — l) /2. 
We create the XOR of the bits in (5i-5>2|i and (5i^i|2 and put the XOR of them in (5i-s>{i,2}- Note that due 
to the symmetry of the channel, similar argument holds for (52-s>i|2 and (52->2|i- 

For (V^- 1) /2 < p < 1, E[Ni^i\i] < E[iVj^-|j], i = 1,2. Therefore after combining the bits, queue Qi^nj 
becomes empty, and we have 

E[iV,_^|,] - E[iV^^^|.] = pq _ (27) 

bits left in Qi^-^i, i = 1,2. 

• Type III Combining the bits in (5j,Ci and Q^^^f Consider the bits that were transmitted in Cases 1, 2, and 3, 



see Figure 22 Now, we observe that providing a ® c and 6 ® / to both receivers is sufficient to decode their 
corresponding bits. For instance, Rxi will have a (B b, c, e (B f , a (B c, and h® f, from which it can recover 
a, c, and e. Similar argument holds for Rx2. Therefore, a © c and 6 © / are bits of common interest and can 
join (5i->{i,2} and (52-5>{i,2} respectively. Hence, we can remove two bits in (5i,Ci and Qi^i\i, by inserting 
their XORs in (5j^.{i,2}' ^ = 1)2, and then deliver this bit of common interest to both receivers during the 
second phase. 
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Fig. 22. Consider the bits transmitted in Cases 1,2, and 3. Now, bit a © c available at Txi and bit & ffi / available at Tx2 are useful for 
both receivers and they are bits of common interest. Therefore, bits a © c and 6 © / can join Qi^{i.2} and Q2->{i,2} respectively. 



For (\/5 - l) /2 < p < 1, we have pq {jp^ — q) < E[A'"j cj- Therefore after combining the bits, queue Qi_^i\i 
becomes empty and we have 



(28) 



bits left in Qi,Ci- 

We treat the remaining bits in Qi^Ci as described before. Hence at the end of Phase 1, if the transmission is not 
halted, we have a total of 



p^q + m^/3 + p^q + m^^^ 

Cases 11 and 12 XOR opportunities 



+0.5 (p^ — p^q + pq^ + m 

^ V 

remaining Case 1 



2/3N 



m 



1 — g^) 0.5pm + 2.5m 



2/3 



(29) 



number of bits in Qi^{i^2}- Same result holds for Q2^{i,2}- 

To summarize, at the end of Phase 1 assuming that the transmission is not halted, by using coding opportunities 
of types I, II, and III, we are only left with (l — g^) ^ 0.5pm + 2.5m^/'^ bits in queue <5j^{i,2}' i = 1, 2. 

We now describe how to deliver the bits of common interest in Phase 2 of the transmission strategy. The problem 
resembles a network with two transmitters and two receivers where each transmitter Txj wishes to communicate an 
independent message Wj to both receivers, i = 1, 2. The channel gain model is the same as described in Section [ill 
We refer to this network as the two-multicast network as depicted in Figure 23 We have the following result for 
this network. 




Fig. 23. Two-multicast network. Transmitter Tx; wishes to reliably communicate message Wi to both receivers, i = 1,2. The capacity 
region with no, delayed, or instantaneous CSIT is the same. 



Lemma 2: For the two-multicast network as described above, we have 

-.No-CSIT _ ^DCSIT _ /^ICSIT 
''multicast '-'multicast '-'multicast i 



^No-CSIT _ ^DCSIT _ /^ICSIT /or,x 
'-'multicast '-'multicast '-'multicast) 



and, we have 

-.ICSIT 



Wicast \ Jl^^Jl^<l_ql ^^'^ 
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This result basically shows that the capacity region of the two-multicast network described above is equal to the 
capacity region of the multiple-access channel formed at either of the receivers. The proof of Lemma [2] is presented 
in Appendix |E] 

Phase 2 [transmitting bits of common interest]: In this phase, we deliver the bits in Qi^{i^2} ^^'^ Q2-5-{i,2} using 
the transmission strategy for the two-multicast problem. More precisely, the bits in Qi^{i^2} will be considered as 
the message of Txj and they will be encoded as in the achievabihty scheme of Lemma |2j i = 1,2. Fix e,6 > 0, 
from Lemma [2| we know that rate tuple 

(i?i,i?2) = ^((l-9')-<5,(l-g')-<5) 

is achievable with decoding error probability less than or equal to e. Therefore, transmission of the bits in (3i_j>{i^2} 
and Q2^{i,2}' will take 

(l — q^)~^ pm + 5m^/^ 
^total = Ti 9\ r 

Therefore, the total transmssion time of our two-phase achievabihty strategy is equal to 

l-g2-V + m3+A ^/ \ , (33) 

(1 — g^j — 

hence, if we let e, 5 — )• and m — )• oo, the decoding error probability of delivering bits of common interest goes 
to zero, and we achieve a symmetric sum-rate of 

R,=R2= lim = , - (34) 



m—^oo 



This completes the achievability proof of point A for 0.5 < p < 1. 



B. Overview of the Achievability Strategy for Comer Point C 

We now provide an overview of the achievability strategy for corner point C depicted in Figure 17 for (3 — \/5) /2 < 
p <1, i.e. 

{Ri,R2) = ipq{l + q),p)^ (35) 

and we postpone the detailed proof to Appendix [D| 

Compared to the achievability strategy of the sum-rate point, the challenges in achieving the other corner points 
arise from the asymmetricity of the rates. At this corner point, while Tx2 (the primary user) communicates at full 
rate of p, Txi (the secondary user) communicates at a lower rate and tries to coexist with the primary user. The 
achievability strategy is based on the following two principles. 

1) If the secondary user creates interference at the primary receiver, it is the secondary user's responsibihty to 
resolve this interference; 

2) For the achievability of the optimal sum-rate point A (see Figure [TTJb)), the bits of common interest were 
transmitted such that both receivers could decode them. However, for corner point C, when the primary 
receiver obtains a bit of common interest, we revise the coding scheme in a way that favors the primary 
receiver. 

Our transmission strategy consists of five phases as summarized below. 

• Phase 1 [uncategorized transmission]: This phase is similar to Phase 1 of the achievability of the optimal 
sum-rate point A. The main difference is due to the fact that the transmitters have unequal number of bits at 
the beginning. In Phase 1, Txi (the secondary user) transmits all its initial bits while Tx2 (the primary user) 
only transmits part of its initial bits. Transmitter two postpones the transmission of its remaining bits to Phase 
3. 

• Phase 2 [updating status of the bits transmitted when either of the Cases 7 or 8 (11 or 12) occurred]: For the 
achievability of optimal sum-rate point A, we transferred the transmitted bits of Tx2 (Txi) to the two-multicast 
sub-problem by viewing them as bits of common interest. However, this scheme turns out to be suboptimal 
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for comer point C. In this case, we retransmit these bits during Phase 2 and update their status based on 
the channel realization at the time of transmission. Phase 2 provides coding opportunities that we exploit in 
Phases 4 and 5. 

Phase 3 [uncategorized transmission vs interference management]: In this phase, the primary user transmits 
the remaining initial bits while the secondary user tries to resolve as much interference as it can at the primary 
receiver. To do so, the secondary user sends the bits that caused interference at the primary receiver during 
Phase 1, at a rate low enough such that both receivers can decode and remove them regardless of what the 
primary transmitter does. Note that pq of the time, each receiver gets interference-free signal from the secondary 
transmitter, hence, the secondary transmitter can take advantage of these time instants to deliver its bits during 
Phase 3. 

Phases 4 and 5 [delivering interference-free bits and interference management]: In the final phases, each 
transmitter has two main objectives: (1) communicating the bits required by its own receiver but available at the 
unintended receiver; and (2) mitigating interference at the unintended receiver. This task can be accomplished 



by creating the XOR of the bits similar to coding type-I described in Section IV with a modification: we first 
encode these bits and then create the XOR of the encoded bits. Moreover, the balance of the two objectives 
is different between the primary user and the secondary user. 

As mentioned before, the detailed proof of the achievability for corner point C is provided in Appendix |D] In 
the following section, we describe the converse proof for the two-user BFIC with Delayed-CSIT. 

VI. Converse Proof of Theorem[2] [Delayed-CSIT] 

In this section, we provide the converse proof for Theorem |2] We first present a lemma that plays a key role in 
deriving the converse. 

Consider the scenario where a transmitter is connected to two receivers through binary fading channels as in 



Figure 
channe 
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Suppose Gi[t\ and G2[t\ are distributed as i.i.d. BernoulU RVs {i.e. G^t] ~ B{p)), i = 1,2. In this 



the received signals are given as 

Y,[t]=G^[t]X[tl i = l,2, (36) 
where X[t\ is the transmit signal at time t. We have the following lemma. 




Fig. 24. A transmitter connected to two receivers through binary fading channels. Using Delayed-CSIT, the transmitter can privilege reveiver 
one to receiver two. Lemma [3] formalizes this privilege. 

Lemma 3: [Entropy Leakage] For the channel described above with Delayed-CSIT and for any input distribution, 
we have 

H (^2"!^") > -^H (yi^lG") . (37) 
2 — p 

Remark 13: Note that with No-CSIT, from the transmitter's point of view, the two receivers are identical and it 
cannot favor one over the other and as a result, we have H {Y2'\G"') = H {Y{^\G^). With Instantaneous-CSIT this 
ratio can become zerc|^ Therefore, this lemma captures the impact of Delayed-CSIT on the entropy of the received 
signals at the two receivers. 

*This can be done by simply remaining silent whenever G2[t] = 1. 
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Proof: For time instant t where 1 < t < n, we have 

H{YMyt\G') 

= pH {X[t]\Yt\G2[t] = l,G'-'] 

''''\H{X[t]\Yt\G' 



>pH {X[t]\Yt\Yt\G') 

- Y^^(^iW'^2[t]ln*'\l^^\G*), (38) 

where (a) holds since X[t\ is independent of the channel realization at time instant t; (6) follows from the fact that 
conditioning reduces entropy; and (c) follows from the fact that Pr [Gi[t\ = G2[t] = 0] = q"^. Therefore, we have 

n ^ n 

Y,H{YMyt\G') > Y.H{YM,Y2[t]\Yt\Yt\G'), (39) 

t=i ^ P t=i 

and since the transmit signals at time instant t are independent from the channel realizations in future time instants, 
we have 

n ^ n 

Y,H{YMy2-\G^) > ^ j;i^(ll[i],1^2[i]|y/-\l^2*"\G"), (40) 
t=i ^ P t=i 

H{Y:^\G^) > -^H{Y^,Yi'\G'') > ^^F(yi"|G") . (41) 
2 J) 2 J} 

This completes the proof of the lemma. ■ 
We now derive the converse for Theorem [2] The outer-bound on Ri is the same under no, delayed, and 
instantaneous CSIT, and we present it in Appendix [B] In this section, we provide the proof of 

+ {1 + q)Rj < p{l + i = 1,2. (42) 

By symmetry, it is sufficient to prove it for f = 1. Let /3 = (l + q), and suppose rate tuple {Ri, R2) is achievable. 
Then we have 

n {Ri + /3i?2) = H{Wi) + pH{W2) 

(a) 



hence, we get 



H{Wi\W2,G'') + PH{W2\G''' 

(Fano) 

< I{Wi ; Fi" I VF2 , G") + PI{W2 ; IT I C") + nen 

H{Y^\W2, G"") - HiY^'lWi, W2, G"") +PH{Y:^\G'^) - I3H{Y:^\W2, G"") + ne. 



= I3H{Y^\G'') + H{Y^\W2,X'2, G") - /3F(y2"| W2, ^2", G") + ne„ 

= PH{Y^\G'') + H{G^^^X'^\W2,Xli, G") - PH{G'I^X'^\W2,X1^ , G") + ne„ 

I3H{Y^\G'') + H{G1^X^\W2, G") - /3i7(G^2^riW^2, G") + ne„ 

(3H{Y^\G'') + F(G!|^iX{*|G") - /3i7(G?2^riG") + ne„ 

Lemma [3] 

< /3/7(y2"|G")+ne„ 



/3Y,H(Y2[t]\Yt\G^)+ner^ 



t=i 

< l3^HiY2[t]\G'') + nen 

t=i 

if) 

< - q^)n + e„ = p{l + qfn + e^. (43) 
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where (a) holds since Wi, W2 and G" are mutually independent; (6) and (c) hold since X2 is a deterministic 
function of W2 and G"; (d) follows from 

< H{G1^X'^\G'') - H{G1^X'l\W2,G'') 
= I (G^iXf ; W2IG") < / (VFi, G'i'iXi"; H^alG") 

= /(M^iiTyzIG") +/(G^iXi";Ty2|VFi,G") = 0, (44) 

^ V ' V ' 

= since Wi±W2±G" = since Xi=fi{Wi, G") 

which implies H {G'^^X'^\G'^) = F(GyiXf | W2, G"), and similarly i7(G^2^]"|G") = -^(G^a^f IW2, G'^); (e) is 
true since conditioning reduces entropy; and (/) holds since the probability that at least one of the links connected 
to Rx2 is equal to 1 at each time instant is {1 — q^). Dividing both sides by n and let n — >• 00, we get 

Ri + {l + q)R2<p{l+q?. (45) 
This completes the converse proof for Theorem [2j 

VII. ACHIEVABILITY PROOF OF THE0REM[3] [DELAYED-CSIT AND OFB] 

We now focus on the impact of the output feedback in the presence of Delayed-CSIT In particular, we demonstrate 
how output feedback can be utilized to further improve the achievable rates. The capacity region of the two-user 
BFIC with Delayed-CSIT and OFB is given by 

^DCSIT,OFB ^ 1^^^ ^2 € M+ s.t. R^ + {1+ q)Rj < p{l + qf, i = 1,2} , (46) 



and is depicted in Figure 25 




Fig. 25. Capacity region of the two-user BFIC with Delayed-CSIT and output feedback. 

The achievability strategy of the corner points (l — g^, O) and (0, 1 — q'^), is based on utilizing the additional 
communication paths created by the means of the output feedback links, e.g., 

Txi — )• Rx2 — )• Tx2 — )• Rxi, 

and is presented in Appendix |F] Here, we only describe the transmission strategy for the sum-rate point, i.e. 

Ri = R2= 1 ^n~?wi ■ (47) 
1 + (1 — g^j 

Let the messages of transmitters one and two be denoted by Wi = ai, 02, • • • , Om, and W2 = 61, 62, • • • , bm, 
respectively, where data bits Oj's and bi's are picked uniformly and independently from {0, 1}, i = 1, . . . , m. We 
show that it is possible to communicate these bits in 



n 



1 - g2) ^rn+{l-q'^) ^ pm + O (m^/^") (48) 



time instants with vanishing error probability (as m — 00). Therefore achieving the rates given in (47 1 as m — >• 00. 
Our transmission strategy consists of two phases as described below. 
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Phase 1 [uncategorized transmission] : This phase is identical to Phase 1 of Section |V] At the beginning of the 
communication block, we assume that the bits at Txj are in queue Qi^i, i = 1,2. At each time instant t, Txj sends 
out a bit from Qi^i, and this bit will either stay in the initial queue or transition to a new queue will take place. 
The transitions are identical to what we have already described in Table |llj therefore, we are not going to repeat 
them here. Phase 1 goes on for 

-1 



'1 



m + m 3 (49) 



or Q2-s>2 is not empty, we declare error 



time instants and if at the end of this phase, either of the queues Qi- 
type-I and halt the transmission. 

The transmission strategy will be halted and an error type-II will occur, if any of the following events happens. 



2 A 

■A A 
+ m 3 = n, 



1,2: 



^^^^{1,2} > E[^^^^{l,2}] + 

From basic probability, we know that 

Pr (Case 1 



2 A 



1,2, and j 
f = 1,2. 



(50) 



1 



Ei=9,io,i3,i6 (Case i 
Ej=i4,i5 Pr (Case j) 
" Z]i=9, 10,13,16 Pr (Case i 

Pr (Case 2) 
" Z]i=9, 10,13,16 Pr (Case i 
Ej=ii,i2 Pr(Case j) 



m 



-1 4 

p m, 



m 



-m 



; Pr (Case i) 



m 



— q^) ^pq'^m, 

2\ — 1 3 

— q j p qm, 
(1 — q^)~^p'^qm. 



(51) 



=9,10,13,16 

Using Chemoff-Hoeffding bound, we can show that the probability of errors of types I and II decreases expo- 
nentially with m. 



At the end of Phase 1, we add O's (if necessary) in order to make queues Qi,c^, Qi^jy, and Qi^{i^2} of size 
equal to nj Ci> and rij^ji 2} respectively as defined in (50l, i = 1,2, and j = For the rest of this 

subsection, we assume that Phase 1 is completed and no error has occurred. We now use the ideas described in 



Section IV for output feedback, to further create bits of common interest. 



Updating the status of bits in Qi,Ci to bits of common interest: As described in Example 3 of Section IV-B 



a bit in Qi,Ci can be considered as a bit of common interest. Also note that it is sufficient to deliver only one of 
the two bits transmitted simultaneously during Case 1 . Therefore, Txi updates the status of the first half of the bits 
in Qi,Ci to (5i-5>{i,2}' whereas Tx2 updates the status of the second half of the bits in (32, Ci to (52-s>{i,2}- Hence, 
after updating the status of bits in Qi^Ci , we have 



2 I 4 

p q+-p 



m H — mi 
2 



(52) 



bits in (5i-s.{i,2}> i = 1,2. 

• Upgrading ICs with side information to a two-multicast problem using OFB: Note that through the output 
feedback links, each transmitter has access to the transmitted bits of the other user during Phase 1. As described 
above, there are E[A'!j_^j|j] + ma bits in Qi^i\i at the end of Phase 1. Now, Txi creates the XOR of the first half 
of the bits in Qi^i\2 and Q2^2\i and updates the status of the resulting bits to Qi_s.{i,2}- Note that as described 



in Example 6 of Section |IVj the XOR of these bits is a bit of common interest. On the other hand, Tx2 creates the 
XOR of the second half of the bits in (5i-s>i|2 and Q2-s>2|i and updates the status of the resulting bits to (52^{i,2}- 
Thus, we have 



2 -^4-^2 

p q + + 2P1 



m + 2m 3 



(53) 
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bits in (5i^{i,2}> i = 1,2. 

• Upgrading ICs with side infomiation and swapped receivers to a two-multicast problem using OFB : As described 
above, there are E[A^j_j.^|j] + ms bits in Txi creates the XOR of the first half of the bits in (5i_s>2|i 

Q2^i|2 ^nd updates the status of the resulting bits to Qi_5>{i,2}- Note that as described in Example 7 of Section 



IV 



the XOR of these bits is a bit of common interest. On the other hand, Tx2 creates the XOR of the second half of 
the bits in Qi^2\i ^^cl (52-i>i|2 ^i^d updates the status of the resulting bits to (52^{i,2}- Hence, we have 



2 ^4 ^2 "^3 

P Q + +2PI +2^9 



5 2 2\-\P 5 2 

m + -ma = [1 — q ) -m + -ma (54) 



bits in (5i_s>{i,2}> i = 1, 2. This completes the description of Phase 1. 

Phase 2 [transmitting bits of common interest]: In this phase, we deliver the bits in Qi^{i^2} ^^d Q2-s>{i,2} using 
the transmission strategy for the two-multicast problem. More precisely, the bits in Qi^{i^2} will be considered as 
the message of Txj and they will be encoded as in the achievability scheme of Lemma [2j i = 1,2. Fix e, (5 > 0, 
from Lemma [2] we know that the rate tuple 

(Ri,R2) = ^ ((1 - 9') - V2, (1 - q^) - 5/2) 

is achievable with decoding error probability less than or equal to e. Therefore, transmission of the bits in Qi_>{i,2} 
and Q2->{1,2} requires 

(1 — q^) ^^ pm + 5m^/^ 

itotal = yz J (55) 

(1 -q^)-5 

time instants. Therefore, the total transmission time of our two-phase achievability strategy is equal to 

1 2 (1 — g^)""'^ »m + 5m^/^ 

l-g2-i^ + m3+^ ^ (56) 

(1 — g^j — 

The probability that the transmission strategy halts at any point can be bounded by the summation of error 
probabilities of types I and II, and the probability that an error occurs in decoding the encoded bits. This probability 
approaches zero for e, 5 — )• and m — )• 00. 

Hence, if we let e,6 ^ and m — )• 00, the decoding error probability goes to zero, and we achieve a symmetric 
sum-rate of 

Ri=R2= lim = ~ ^ • (57) 

e,5^0 ttotal 1 + (1 - 
m— >-oo 
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VIII. Converse Proof of Theorem[3][Delayed-CSIT and OFB] 

In this section, we prove the converse for Theorem |3] Suppose rate tuple R2) is achievable, then by letting 
/3 = 1 + (7, we have 

n {Ri + /3i?2) = HiWi) + ^HiW2) 

H{Wi\W2, G") + PH{W2\G'') 

Fano 

< I{Wi ; I , G'^) + PI{W2 ; Y2" I G") + nen 

< I{Wi; Yi", Y^'\W2, G") + pI{W2; + ne„ 

= y2"|W2, G") - Y^\Wi, W2, G") +/3i/(y2"|G") - /3H{Y^\W2, G") + ne„ 

^ V ' 

= 

= ^/i'(y2"|G") + //(Fi", y2"l W^2, G") - /3//(y2"|VF2, G") + ne„ 

n 71 

= /3i/(y2"|G") + J] i/(yi[t], F2[t]|T^2, y2*"\ G") - /3 J] F(y2MI W^2, y2*"\ G") + ne„ 
t=i t=i 

(6) 

< pH{Y^^\Gn + J2H{Yi[t],Y2[t]\W2,Yl-\Yt\xlG^) - /3^H{Y2[t]\W^^ 

t=i t=i 



= /3i/(r2"|G") + ^i/(Gn[t]Xi[t],Gi2[t]Xi[t]|ty2,G*lixJ-\Gl2'xJ-i,X*,G") 
t=i 

n 

- /3 J] i/(Gi2[t]Xi[t]|H^2, G*2'xJ-\ X*, G") + ne, 

n 

PH{Y^\G-) + J] i7(Gn[t]Xi[t], Gi2[t\Xi[t\\W2, G'{i^ X\-\ G\l,^ X\-\ G*) 
t=i 

n 

- !3Y,H{Gi2[t\XMW2,G'y,^X{-\xlG') + nen 
t=i 

< /3i/(y2"|G") + ne„ 

<p(l + g)2n + ne„, (58) 

where (a) holds since the channel gains and the messages are mutually independent; (6) follows from the fact that 
X^2 is a deterministic function of (1^2)^2*"^)!^^'^'^ ^^^^ ^^^^ conditioning reduces entropy; (c) follows from the 
fact that condition on W2, X^^, X^, Xi[t\ is independent of the channel realization at future time instants, hence, 
we can replace G" by G*; and {d) follows from Lemma |4] below. Dividing both sides by n and let n — 00, we get 

Ri + {l + q)R2<v{^ + q?- (59) 

Similarly, we can get (1 + q)Ri + i?2 < p(l + 9)^- 
Lemma 4: 

n 

Y,il{G^2\i\X^\tW2.G'{-^^X{-\xlG') 

t=\ 

n 

> Y1 H{Gn[t]Xi[t],Gi2[t]Xi[t]\W2, G\-,' Xl-\ G'f^' X{-\ X^, G*). (60) 

^ P t=i 

^We have also added Y^~^ in the condition for the scenario in which output feedback links are available from each receiver to both 
transmitters. 
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Proof: We have 

H[Gi2[t]XMW2,G'^^'x\-\xlG') 

= pH{XMGi2[t] = l,W2,G'y,^X\-\xlG'~^) 

pH{XMW2.G'^^^X{-\xlG'-^) 



> 



pH{Xi[t]\W2,G\^^Xl-\xlG' 



P 



1-q- 
1 



;H{Gn[t]Xi[t],Gi2[t]Xi[t]\W2,G\-^'xl-\xiG') 



2-p 



H{Gu [t]Xi [t] , Gi2 [t]Xi [t] I W2 , G\-,'Xl- ' , G\"^'Xl-\ X* , G*) , 



(61) 



where (a) and (6) follow from the fact that condition on W2, G*[2^Xl^^, X2 and G", Xi[t] is independent of the 
channel realization at time t; and (c) holds since conditioning reduces entropy. 
Therefore, we have 

n 

^H{Gi2[t]Xi[t]\W2,Gt2'xi-\xiG') 
1 



t=i 



> 



P 



J2H{Gn[t]Xi[t],Gi2[t]XMW2,G\-,'xl-\G\-2'xl-\xlG'). 



In the following two sections, we consider the last scenario we are interested in, i.e. Instantaneous-CSIT and 
OFB, and we provide the proof of Theorem |4] First, we present the achievability strategy, and we demonstrate how 
OFB can enhance our achievable rate region. We then present the converse proof. 

IX. Achievability Proof of Theorem|4] [Instantaneous-CSIT and OFB] 

In this section, we describe our achievability strategy for the case of Instantaneous-CSIT and output feedback. 
Note that in this scenario, although transmitters have instantaneous knowledge of the channel state information, the 
output signals are available at the transmitters with unit delay. We first provide a brief overview of our scheme. 

A. Overview 

By symmetry, it suffices to describe the achievability scheme for corner point 



'1 



,pq) , 



as depicted in Figure 26 Similarly, we can achieve comer point (i?i,i?2) = {pQ, 1 — 9^)> and therefore by time 
sharing, we can achieve the region. 



(l-q2,pq) 




(pq,l-q2) 



Fig. 26. Two-user Binary Fading IC: capacity region with Instantaneous-CSIT and output feedback. By symmetry, it suffices to describe 
the achievability scheme for corner point (7?i, _R2) = (l 



Our achievability strategy is carried on over b + I communication blocks, each block with n time instants. 
Transmitters communicate fresh data bits in the first b blocks and the final block is to help the receivers decode 
their corresponding bits. At the end, using our scheme, we achieve a rate tuple arbitrary close to (l — q^,pq) 
as 71 — )■ 00. Finally letting 6 — )• 00, we achieve the desired rate tuple. 
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B. Achievability Strategy 

Let be the message of transmitter i in block j, i = 1,2, and j = 1,2, Moreover, let Wj = 

a\,a2, ■ ■ ■ ,am, and = 63, . . . , 6m2> for J = 1, 2, . . . , 6, where data bits a^'s and 6^'s are picked uniformly 
and independently from {0,1}, i = l,2,...,m, and 

7712 = — — m. (62) 
1 + 9 

We also set n = m/{l — q^) + w?!"^, where n is the length of each block. 

Achievability strategy for block 1: In the first communication block, at each time instant t, if at least one of 
the outgoing links from Txi is on, then it sends one of its initial m bits that has not been transmitted before (note 
that this happens with probability (1 — g^)). On the other hand, Tx2 communicates a new bit (a bit that has not 
been transmitted before) if the link to its receiver is on and it does not interfere with receiver one {i.e. G22[i] = 1 
and G21 \t\ = 0). In other words, Tx2 communicates a new bit if either one of Cases 2, 4, 9, or 11 in Table |ll] occurs 
(note that this happens with probability pg). 

The first block goes on for n time instants. If at the end of the first block, there exists a bit at either of the 
transmitters that has not yet been transmitted, we consider it as error type-I and halt the transmission. 

Assuming that the transmission in not halted, using output feedback links, transmitter two has access to the bits 
of transmitter one communicated in the first block. In particular, Tx2 has access to the bits of Txi transmitted in 
Cases 2, 11, 12, 14, and 15 during block 1. Note that the bits communicated in Cases 11, 12, 14, and 15 from Txi 
have to be provided to Rxi. However, the bits communicated in Case 2 from Txi are already available at Rxi but 
needed at Rx2, see Figure 27 Transmitter two will provide such bits to Rx2 in the following communication block. 




Fig. 27. The bit communicated in Case 2 from Txi is already available at Rxi but it is needed at Rx2. Transmitter two learns this bit 
through the feedback channel and will provide it to Rx2 in the following communication block. 

Now, Tx2 transfers the bits of Txi communicated in Cases 2, 11, 12, 14, and 15, during the first communication 
block to queues Q\ Q\ (-^^, Q\ (-^^, Q\ (-^^, and Q\ (-^^ respectively. 

Let random variable denote the number of bits in Q\ (-^, £ = 2, 11, 12, 14, 15. Since transition of a bit to 

this state is distributed as independent Bernoulli RV, upon completion of block 1, we have 

W^\^^ = - Pr(Case ^) = (1 - g^)-! Pr (Case ^) m, ^ = 2,11,12,14,15. (63) 



If the event 



occurs, we consider it as error type-II and we halt the transmission. At 

the end of block 1, we add O's (if necessary) to Q\ so that the total number of bits is equal to KlN^f-^] + ms. 
Furthermore, using Chernoff-Hoeffding bound, we can show that the probability of errors of types I and II decreases 
exponentially with m. 

Achievability strategy for block j, j = 2, 3, . . . , 6: The transmission strategy for Txi is the same as block 
1 for the first b blocks (all but the last block). In other words, at time instant t, Txi transmits one of its initial 
m bits (that has not been transmitted before) if at least one of its outgoing links is on. On the other hand, Tx2 
communicates using similar strategy as the first block, i.e. Tx2 communicates a new bit if either one of Cases 
2, 4, 9, or 11 occurs. 

Transmitter two transfers the bits communicated in Cases 2, 11, 12, 14, and 15, during communication block j 
to queues Qi Ca' Qi Cn' Qi C12' Qi C14' Qi Ci- respectively. 
Moreover, at time instant t, 
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if Case 3 occurs, Tx2 sends one of the bits from and removes it from this queue since it has been 

deUvered successfully to Rx2, see Figure 28 If Case 3 occurs and Q{ q is empty, Tx2 remains silent; 





Fig. 28. In block j when Case 3 occurs, Tx2 retransmits the bit of Txi communicated in Case 2 during block j — 1. Note that this bit 
does not cause interference at Rxi and it is needed at Rx2. 



if Case 10 occurs, Tx2 sends one of the bits from ^^^^ and removes it from this queue, see Figure 
Case 10 occurs and Q{ q^^ is empty, Tx2 remains silent; 
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If 





Fig. 29. In block j when Case 10 occurs, Tx2 retransmits the bit of Txi communicated in Case 11 during block j — 1. Note that this bit 
is needed at both receivers. 

• if Case 12 occurs, it sends one of the bits from Q{ q^^ and removes it from this queue. If Case 12 occurs and 
Q{~q^^ is empty, Tx2 remains silent; 

• if Case 13 occurs, it sends one of the bits from Q{ q^^ and removes it from this queue. If Case 13 occurs and 
Qi~Cii empty, Tx2 remains silent; 

• if Case 15 occurs, it sends one of the bits from Q^ q^^ and removes it from this queue. If Case 15 occurs and 
Q{~q^^ is empty, Tx2 remains silent. 

If at the end of block j, there exists a bit at either of the transmitters that has not yet been transmitted, or any 
of the queues Q{~q^, Qi~Cii^ ^i^L' ^i^^i4' ^i^Cn, empty, we consider this event as error type-I and halt 

the transmission. 

Assuming that the transmission is not halted, let random variable denote the number of bits in Q\ , 

£ = 2, 11, 12, 14, 15. From basic probability, we have 



If the event 



Pr (Case I) 



1-E 



j=9,10,13,16 



Pr (Case i 



-m 



(1 - g^)"^ Pr (Case i)m, £ = 2, 11, 12, 14, 15. 



(64) 



occurs, we consider it as error type-II and we halt the transmission. At the 

end of block 1, we add O's (if necessary) to so that the total number of bits is equal to E[A'^^ (- J + . Using 

Chemoff-Hoeffding bound, we can show that the probability of errors of types I and II and decreases exponentially 
with m. 



b+i w^'+i 



Achievability strategy for block 6+1: Finally in block 6+1, no new data bit is transmitted (i.e. W"^ , 



0), 



and Tx2 only communicates the bits of Txi communicated in the previous block in Cases 2, 11, 12, 14, and 15 as 
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described above. If at the end of block 6+1, any of the queues q^, Q\ q^^, Q\ q^^, Q\ q^^, or Q\ (- is not 
empty, we consider this event as error type-I and halt the transmission. 

The probability that the transmission strategy halts at the end of each block can be bounded by the summation 
of error probabilities of types I and II. Using Chernoff-Hoeffding bound, we can show that the probability that the 
transmission strategy halts at any point approaches zero as m — ;> oo. 



C. Decoding 

At the end of block j + 1, Rxi has acces to W{ with no interference, j = 1,2, . . . ,b. At the end of block b+1, 
Rx2 uses the bits communicated in Cases 3 and 10 from Tx2 to cancel out the interference it has received from 
Txi during the previous block in Cases 2 and 11. Therefore, at the end of block 6 + 1, Rxi has access to with 
no interference. Then, Rx2 follows the same strategy for blocks 6 and 6—1. Therefore, using similar idea, Rx2 uses 
backward decoding to cancel out interference in the previous blocks to decode all messages. 

Now, since each block has n = m/{l — q^)+m'^/^ time instants and the probability that the transmission strategy 
halts at any point approaches zero for m — )• oo, we achieve a rate tuple 

T^{l-q\pq), (65) 
6+1 

as m — )■ oo. Finally letting 6 — oo, we achieve the desired rate tuple. 

X. Converse Proof of Theorem|4][Instantaneous-CSIT and OFB] 
To derive the outer-bound on individual rates, we have 

nRi = H{Wi) = H{Wi\G'') 

(Fano) 

< /(VFi;yi"|G") + ne„ 
= F(yi"|G") - H{Y^\Wi, G") + nen 

< F(yi"|G") + ne„ 

< (1 - q^)n + nen, (66) 
where — )■ as n — oo; (a) holds since message Wi is independent of G". Similarly, we have 

ni?2 < (1 - q^)'n + nen, (67) 
dividing both sides by n and let n — >• oo, we have 

f i?i < 1 - 

< o (68) 

I i?2<l-g'. 



The outer-bound on i?i + i?2, i.e. 



Ri+R2<l-q^+pq, (69) 
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can be obtained as follows. 

n{Ri + R2- 2e„) 

(a) 

< H{Wi\W2,G'') + H{W2\G'') 

Fano 

< I{Wv,y;'\W2,G'') + I{W2;Y^\G'') 
= H{Y{'\W2, G"") - H{Y^\Wi, W2, G") +I{W2; Y^IG"") 

^ V ' 

= 

= H{Y^\W2,G'') + HiY^lG"") - H{Y^\W2,G'') 

= H{Y^\W2, G") + HiY^lG"") - [H{Y{', Y^\W2, G") - HiY^lYj", W2, G")] 
= H{Y^\Y^, W2, G") + HiY^lG"") 

n 

H{Y2^\G^) + HiYi [t]\W2,Y2^, Yt\xl G*2X*, G") 

i=l 

(c) 

< R{Y^\G'') + li{Y^\G'l2X'^, G^^X^, G") 

< HiY2 [t] I G-) + ^ HiY, [t] I G12 [t]X, [t] , G21 [t]X2 [t] , G") 
t=i t=i 

(e) 

< (1 - q^)n+pqn, (70) 

where en — )■ as n — 00; and (a) follows from the fact that the messages and G" are mutually independent; (6) 
holds since is a function of W2, Y^~^ ,Y2~^ , and G*; (c) and (d) follow from the fact that conditioning reduces 
entropy; and (e) holds since 

H{Y2[t]\Gn<l-q-', 

H{Yi[t]\Gi2[t]Xi[t],G2i[t]X2[t],G'') < pq. (71) 

Dividing both sides by n and let n — )• 00, we get 

Ri+R2<l-q^+ pq. (72) 

We also note this outer-bound on Ri + R2 can be also applied to the case of Instantaneous-CSIT and no output 
feedback (i.e. Theorem [T]). 



XI. Conclusion and Future Directions 

We studied the impact of delayed knowledge of the channel state information at the transmitters, on the capacity 
region of the two-user binary fading interference channels. We introduced various coding opportunities, created 
by Delayed-CSIT, and presented an achievability strategy that systematically exploits the coding opportunities. We 
derived an achievable rate region that matches the outer-bounds for this problem, hence, characterizing the capacity 
region. We have also derived the capacity region of this problem with Delayed-CSIT and output feedback. 

A future direction would be to extend our results to the case of two-user Gaussian fading interference channel with 
Delayed-CSIT As discussed in the introduction, one can view our binary fading model as a fading interpretation 
of the linear deterministic model where the non-negative integer associated to each link is at most 1. Therefore, 
one approach is to extend the current results to the case of fading linear- deterministic interference channel and 
then, further extend that result to the case of Gaussian fading interference channel, in order to obtain approximate 
capacity characterization. 

Another future direction is to consider the fc-user setting of the problem. In f23], authors have shown that for 
the fc-user fading interference channel with instantaneous knowledge of the channel state information, sum degrees 
of freedom (DoF) of k/2 is achievable. However, in the absence of the CSIT, the achievable sum DoF collapses 
to 1. As a result a large degradation in network capacity, due to lack of the CSIT, is observed. It has been recently 
shown that, with Delayed-CSIT, it is possible to achieve more than one sum DoF |7J, ||8j|, however, the achievable 
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(a) (b) 
Fig. 30. Capacity region of the two-user BFIC with Instantaneous-CSIT and for (a) < p < 0.5, and (b) 0.5 < p < 1. 



sum DoFs are less than 1.5 for any number of users. This together with lack of nontrivial DoF upper bounds leaves 
the problem of sum DoF characterization of interference channels with Delayed-CSIT still open and challenging, 
to the extent that it is even unknown whether the sum DoF of such networks scales with the number of users or 
not. A promising direction may be to study this problem in the context of our simpler binary fading model, to 
understand whether the sum capacity of such network with Delayed-CSIT scales with the number of users or it 
will saturate. 

Finally, motivated by recent results that demonstrate that, with Instantaneous-CSIT, multi-hopping can signifi- 
cantly increase the capacity of interference networks {e.g., p4| , |j25l for two-unicast networks and fSS] for multi- 
unicast networks), an interesting future direction would be explore the impact of Delayed-CSIT on the capacity of 
muti-hop binary interference networks. 



Appendix A 

ACHIEVABILITY PROOF OF THE0REM[T] [iNSTANTANEOUS-CSIT] 

In this appendix, we provide the achievability proof of Theorem [T] Below, we have stated the capacity region of 
the two-user BFIC with Instantaneous-CSIT (and no OFB). 

^icsiT 0<Ri<p, i = 1,2, 

\ R1+R2 <l-q'^+pq. 

Remark 14: For < p < 0.5, the capacity region is given by 

^icsiT ^ 1^^^ ^2 G M+ s.t. R^<p, 1 = 1,2} . (74) 

while for 0.5 < p < 1, the outer-bound on Ri + R2 is also active, see Figure [30] 

With Instantaneous-CSIT, each transmitter knows what channel realization occurs at the time of transmission. 
Transmitters can take advantage of such knowledge and by pairing different realizations, the optimal rate region as 
given in Theorem [T] can be achieved. We will first describe the achievability strategy for < p < 0.5, since it is 
easier to follow. We then complete the proof by describing the achievability strategy for 0.5 < p < 1. 



A. Achievabiliy Strategy for < p < 0.5 

Note that the result for p = is trivial, so we assume < p < 0.5. Below, we describe the possible pairing 
opportunities that are useful in this regime and then, we describe the achievability scheme. The possible pairing 
opportunities are as follows. 

• Type A [Cases 1 and 15]: In Case 15, only the corss links are equal to 1, therefore, by pairing bits in Case 1 
with bits in Case 15, we can cancel out interference in Case 1, see Figure 31 In other words by pairing the 
two cases, we can communicate 2 bits interference free. 

• Type B [Cases 2 and 14]: We can pair up Cases 2 and 14 to cancel out interference in Case 2 as depicted in 
Figure [32 
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Fig. 31. Pairing opportunity Type A: By pairing Cases 1 and 15, we can communicate two bits interference-free. For instance, receiver 
one has access to bits a © fe and b and as a result, it can decode its desired bit. 



Txi Rxi Txi Rxi 




Fig. 32. Pairing opportunity Type B: By pairing Cases 2 and 14, we can communicate two bits interference-free. For instance, receiver 
two has access to bits a © 6 and a and as a result, it can decode its desired bit. 

• Type C [Cases 3 and 13]: Similar to Type B with swapping user IDs. 

We are now ready to provide the achievability scheme for the Instantaneous-CSIT model and for < p < 0.5. 
We first provide an overview of our scheme. 

1 ) Overview: Our achievability strategy is carried on over 6+1 communication blocks, each block with n time 
instants. We describe the achievability strategy for rate tuple 

{Ri,R2) = ip,p). (75) 

Transmitters communicate fresh data bits in the first b blocks and the final block is to help the receivers decode 
their corresponding bits. At the end, using our scheme, we achieve rate tuple {p,p) as n — )• oo. Finally, letting 
6 — oo, we achieve the desired rate tuple. In our scheme the messages transmitted in block j, j = 1,2, . . . ,b, will 
be decoded at the end of block j + 1. 

2) Achievability strategy: Let W^ be the message of transmitter i in block j, i = 1,2, j = 1,2, . . . ,b. Moreover, 
let W-J = a\, ■ ■ ■ , aln, and Wg = 6{, • • • ) &m, where a^'s and ftj 's are picked uniformly and independently 
from {0, 1}, i = 1,2, . . . ,m, j = 1,2, . . . ,b, and some positive integer m. We set 

n = m/p+ (2//) m^/^. (76) 

Achievability strategy for block 1: In the first communication block, at each time instant t, Txj sends a new 
data bit (from its initial m bits) if Gii[t] = 1, i = 1,2. In other words, Txi sends a new data bit either of the 
following channel realizations occurs (see Table |ll]): Cases 1,2,3,4,5,6,7, and 8; while Tx2 sends a new data bit 
if either of the following channel realizations occurs: Cases 1, 2, 3, 4, 9, 10, 11, and 12. 

If not specified, the transmitters remain silent. Txi transfers its transmitted bits in Cases 1 and 2 to queues 
Q\ f-]^ and Q\ respectively; and Tx2 transfers its transmitted bits in Cases 1 and 3 to queues Q\ ^-y and Q\ ^-3 
respectively. 

If at the end of block 1, there exists a bit at either of the transmitters that has not yet been transmitted, we 
consider it as error type-I and halt the transmission. 
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Remark 15: Note that the transmitted bits in Cases 4, 5, 6, 7, 8, 9, 10, 11, and 12 are available at their correspond- 
ing receivers without any interference. In other words, they are communicated successfully and no retransmission 
is required. 

Assuming that the transmission is not halted, let random variable iV^^c^ denote the number of bits in Q\q^, 
{i, t) = (1, 1), (1, 2), (2, 1), (2, 3). Since transition of a bit to this queue is distributed as independent BemoulU RV, 
upon completion of block 1, we have 



If the event 



occurs, we consider it as error type-II and we halt the transmission. At 

the end of block 1, we add O's (if necessary) to Q\q^ so that the total number of bits is equal to E[A^^^ ] + ma. 
Furthermore, using Chernoff-Hoeffding bound, we can show that the probability of errors of types I and 11 decreases 
exponentially with m. 

AchievabOity strategy for block j, j = 2,3, ... ,b: In communication block j, j = 2, 3, . . . , 6, at each time 
instant t, Txj sends a new data bit (from its initial m bits) if Gii[t] = 1, i = 1,2. Transmitter one transfers its 
transmitted bit in Cases 1 and 2 to queues and Q{ ^2 respectively; and Tx2 transfers its transmitted bit in 

Cases 1 and 3 to queues Q2 and Q2 C3 respectively. Note that so far the transmission scheme is similar to the 
first communication block. 

Now if at a given time instant Case 15 occurs, Txj sends a bit from queue Qi^\ and removes it from the 
this queue. If at time instant t Case 15 occurs and empty, then Txj remains silent. This way, similar to 

pairing Type A described previously, the transmitted bits in Case 1 of the previous block can be decoded at the 
corresponding receiver 

Furthermore, if at a given time instant Case 14 (13) occurs, Txi (TX2) sends a bit from queue Q{~c2 (^2^3) 
removes it from the this queue. This is motivated by pairing Type B (C) described previously. 

If at the end of block j, there exists a bit at either of the transmitters that has not yet been transmitted, or any 
of the queues Q{ q^, Qi q^' Oi ci' ^2^1 empty, we consider this event as error type-I and we halt the 

transmission. 

Assuming that the transmission is not halted, let random variable iV/c^ denote the number of bits in QIq^, 
{i, i) = (1, 1), (1, 2), (2, 1), (2, 3). Since transition of a bit to this state is distributed as independent Bemoulh RV, 
upon completion of block j, we have 



If the event 



occurs, we consider it as error type-II and we halt the transmission. At the 

end of block 1, we add O's (if necessary) to Q'Iq^ so that the total number of bits is equal to E,[N^(-^] +7713. Using 
Chernoff-Hoeffding bound, we can show that the probability of errors of types I and II decreases exponentially 
with m. 

Achievability strategy for block 6-1-1: In the final communication block, transmitters do not communicate any 
new data bit. 

If at time instant t Case 15 occurs, Txj sends a bit from queue Q^qi and removes it from the this queue. If at 
time instant t Case 15 occurs and Q'^qi is empty, then Txj remains silent. If at time instant t Case 14 (13) occurs, 
Txi (TX2) sends a bit from queue ^2 (Q2 cs) removes it from the this queue. 

If at the end of block 6 + 1, any of the states Q\ q^, Q\ q^, Q2 q^, or Q2 is not empty, we consider this event 
as error type-I and we halt the transmission. 

Note that if the transmission is not halted, any bit is either available at its intended receiver interference-free, 
or the interfering bit is provided to the receiver in the following block. The probability that the transmission 
strategy halts at the end of each block can be bounded by the summation of error probabilities of types I and II. 
Using Chernoff-Hoeffding bound, we can show that the probability that the transmission strategy halts at any point 
approaches zero as m — > 00. 
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Now, since each block has n = m/p+ m^/^ time instants and the probability that the transmission strategy 

halts at any point approaches zero as m — oo, we achieve a rate tuple 

l^^P^P)^ (79) 
as m — )■ oo. Finally letting 6 — )• cxd, we achieve the desired rate tuple. 

B. Achievabiliy Strategy for 0.5 < p < 1 

For p = 1, the capacity region is the same with no, delayed, or instantaneous CSIT. So in this section, we assume 
0.5 < p < 1. By symmetry, it suffices to describe the strategy for point A = {p, 2pq). In this regime, we will take 
advantage of another pairing opportunity as described below. 

• Type D [Cases 2, 3, and 12]: This type of pairing is different from what we have described so far. In all previous 
types, we paired up cases that had zero capacity to cancel out interference in other cases. However, here all three 



cases have capacity 1. By pairing all three cases together, we can communicate 4 bits as depicted in Figure 33 




Fig. 33. Pairing opportunity Type D: Cases 2, 3, and 12. Txi uses c to recover b and then it decodes a, similar argument holds for Tx2. 
All three cases have capacity 1, and by pairing them, we can communicate 4 bits. 



1 ) Overview: The achievability is again carried on over 6 + 1 communication blocks, each block with n time 
instants. We describe the achievability strategy for rate tuple 

iRi,R2) = {p,2pq), (80) 

see Figure [30l^b). 

Transmitters communicate fresh data bits in the first b blocks and the final block is to help receivers decode their 
corresponding bits. At the end, using our scheme, we achieve rate tuple {p, 2pq) as n — )• oo. Finally, letting 
6 — > oo, we achieve the desired corner point. In our scheme, the transmitted bits in block j, j = 1,2, ... ,b, will 
be decoded by the end of block j + 1. 

2) Achievability strategy: Let W;- be the message of transmitter i in block j. We assume W{ = a{, . . . , a^, 
and W2 = &{, 62, . . . , for j = 1, 2, . . . , 6, where a^'s and fr^'s are picked uniformly and independently from 
{0, 1}, for some positive value of m and 7712 = 2qm (note that 2q < 1). We set 

n = m/p+ {2/q*)m'^/^. (81) 

Achievability strategy for block 1: In the first communication block, at each time instant t, transmitter one 
sends a new data bit if Gii[t] = 1 except Case 1. In other words, Txi sends a new data bit if either of the following 
channel realizations occurs (see Table [ll]): Cases 2,3,4,5,6,7, and 8. Transmitter two sends a new data bit if 
G'22[i] = 1 except Cases 1 and 12. In other words, Tx2 sends a new data bit if either of the following channel 
realizations occurs: Cases 2,3,4,9,10, and 11. 

If at time instant t where t < pn, Case 1 occurs, then each transmitter sends out a new data bit. Then, Txj 

transfers its transmitted bit in Case 1 to queue Qj^i for t < If t > %n and Case 1 occurs, then Txi sends out 



a new data bit while Tx2 remains silent, see Figure 34 Note that these bits are delivered to Rxi interference-free. 
2 I — ' 
If t < pn, and Case 12 occurs, then Tx2 sends out a new data bit while Txi remains silent. Note that these 

bits are delivered to Rx2 interference-free. 
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Communication block 1 
n time instants 



< 








► 
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'Mmv//////////////////////,^ 









only transmitter one 
communicates 

2 2 

Fig. 34. If Case 1 occurs during communication block 1, then if t < '^n, each transmitter sends out a new data bit. However, if t > ^n, 
then Txi sends out a new data bit while Tx2 remains silent. 




both transmitters 
communicate 



If not specified, tlie transmitters remain silent. Note that Txi sends a bit if = 1 {i.e. with probability p). 

On the other hand, Tx2 sends a bit with probabiUty 

Pr (Case j) + 4 E ^^^^^ j) = ^i"?- (82) 

j=2,3,4,9,10,ll ^ i=l,12 

Transmitter one transfers its transmitted bit in Case 2 to queue C2' ^'^'^ '''^2 transfers its transmitted bit in 
Case 3 to queue Q\ (-3. If at the end of block 1, there exists a bit at either of the transmitters that has not yet been 
transmitted, we consider it as error type-I and halt the transmission. 

Remark 16: Note that the transmitted bits in Cases 4, 5, 6, 7, 8, 9, 10, and 11 are available at their corresponding 
receivers without any interference. 

Assuming that the transmission is not halted, let random variable N^^^ denote the number of bits in Q\q^, 
{i,£) = (1, 1), (1, 2), (2, 1), (2, 3). Since transition of a bit to this state is distributed as independent BemoulU RV, 
upon completion of block 1, we have 

r 1 . (g2 V) PrfCase 1) , 

„-,r,xi 1 Pr (Case 2) 9 

r 1 . (q^/p'^) Pr (Case 1) „ 

Ej=2,3,4,9,io,ii P^ (Case j) + 2j Ej=i,i2 (Case j) 

Lj=2,3,4,9,io,ii Pr (Case + p Lj=i,i2 Pr (Case j) 

If the event N^q^ > ]E[A^/(;J + occurs, we consider it as eiTor type-II and we halt the transmission. At the 

end of block 1, we add O's (if necessary) to QIq^ so that the total number of bits is equal to K[Nl(-^J +m3 . Using 
Chernoff-Hoeffding bound, we can show that the probability of errors of types I and II decreases exponentially 
with m. 

Achievability strategy for block j, j = 2,3, ... ,b: In communication block j, j = 2,3, ... ,b, at each time 
instant t, transmitter one sends a new data bit if Gii[t] = 1 except Case 1, while transmitter two sends a new data 
bit if G22[t] = 1 except Cases 1 and 12. 

If t < and Case 1 occurs, then each transmitter sends out a new data bit. Then Tx, transfers its transmitted 

bit in Case 1 to queue Q^qi for t < ^n. If i > and Case 1 occurs, then Txi sends out a new data bit while 
Tx2 remains silent. Note that these bits are delivered to Rxi interference-free. 

„2 

If t < \n and Case 12 occurs, then Tx2 sends out a new data bit while Txi remains silent. We will exploit 

^ „2 

channel realization 12 for t > ^n, to perform pairing Type D. 

Transmitter one transfers its transmitted bit in Case 2 to queue Q-[ ^^'^ and transmitter two transfers its transmitted 
bit in Case 3 to queue ^3. Note that so far the transmission scheme is similar to the first communication block. 
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If the event 



Now, if at time instant t Case 15 occurs, Tx, sends a bit from queue Q^ ^} and removes it from the this queue. 

If at time instant t Case 15 occurs and Q{~q\ is empty, then Txj remains silent. This way, similar to pairing Type 
A described previously, the transmitted bits in Case 1 of the previous block can be decoded at the corresponding 
receiver. 

Furthermore, if at time instant t Case 14 (13) occurs, Txi (Tx2) sends a bit from queue Q{ q2 ^Qi cs^ ^^'^ 
removes it from the this queue. This is motivated by pairing Type B (C) described previously. 

Finally, if t > and Case 12 occurs, Txi sends a bit from queue Q{ q2 ^^'^ '''^2 sends a bit from queue Q2 Q3- 
Each transmitter removes the transmitted bit from the corresponding queue. This is motivated by pairing Type D 
described above. 

If at the end of block j, there exists a bit at either of the transmitters that has not yet been transmitted, or any 
of the states Q{~qi, Qi c2^ Qi cv Q2 C3 empty, we consider it as error type-I and halt the transmission. 

Assuming that the transmission is not halted, let random variable A^^^ denote the number of bits in Q^r- , 
{i,£) = (1, 1), (1, 2), (2, 1), (2, 3). Since transition of a bit to this state is distributed as independent BemoulU RV, 
upon completion of block j, we have 

r . (gVP^) Pr (Case 1) . 

,T^r,Ti 1 (Case 2) n 

l-Ei=9,io,...,i6Pr(Casej) 

r n (gVp^) Pr (Case 1) „ 

Ej=2,3,4,9,io,ii Pr (Case j) + 2^ Ej=i,i2 Pr (Case j) 

c ] = ^T{Case?,) = piqrn. (84) 

Ej=2,3,4,9,io,ii P^ (Case j) + ^2 Ej=i,i2 Pr (Case j) 

occurs, we consider it as error type-II and we halt the transmission. At the 

end of block 1, we add O's (if necessary) to Q{q^ so that the total number of bits is equal to E[A^^^(- ] +m3. Using 
Chernoff-Hoeffding bound, we can show that the probability of errors of types I and II decreases exponentially 
with m. 

Achievability strategy for block 6+1: In the final communication block, transmitters do not communicate any 
new data bit. 

If at time instant t Case 15 occurs, Txj sends a bit from queue Q\qi and removes it from the this queue. If at 
time instant t Case 15 occurs and Q\qi is empty, then Txj remains silent. If at time instant t Case 14 (13) or 12 
occurs, Txi (TX2) sends a bit from queue Q\ {Q\ C3) ^'i^ removes it from the this queue. 

If at the end of block j any of the states Q5 ci' C2' Q\cv Q\ C3 ^rnpty. we consider it as error 

type-I and halt the transmission. 

Note that if the transmission is not halted, any bit is either available at its intended receiver interference-free, 
or the interfering bits is provided to the receiver in the following block. The probability that the transmission 
strategy halts at the end of each block can be bounded by the summation of error probabilities of types I and II. 
Using Chernoff-Hoeffding bound, we can show that the probability that the transmission strategy halts at any point 
approaches zero for m — )• 00. 

Now, since each block has n = m/p+ (2/g^) m?/^ time instants and the probability that the transmission strategy 
halts at any point approaches zero for m — )• 00, we achieve a rate tuple 

^ (P, 2pg) , (85) 
as m — )• 00. Finally letting 6 — )• 00, we achieve the desired rate tuple. 

Appendix B 

Converse Proof of Theorem[T][Instantaneous-CSIT] 

The derivation of the outer-bound on individual rates is simple, however for the completeness of the results, we 
include the proof here. This outer-bound can be used for other theorems as needed. To derive the outer-bound on 
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Ri, we have 

nRi = H{Wi) = 

= H{Wi\X^,G'') 

(Fano) 

< I{Wi;Y,^\X^,G'') + nen 

(data proc.) 

< I{X^;Y{'\X^,G^) + nen 
= H{Y^\X1^, G") - H{Y{'\X'i, X^, G") + ne„ 
= H{G^^X^\X^,G^) + nen 

<pn + nen, (86) 

where — )• as n — oo; (a) holds since message Wi is independent of G"; and {b) holds since given G", Wi 
is independent of X2, see ([44|. Similarly, we have 



ni?2 < pre + nen- (87) 
dividing both sides by n and let n — > 00, we have 

i Ri<P 

< (88) 
The outer-bound on Ri + i?2 follows from the proof of Theorem |4] in Section |X] 

Appendix C 

ACHIEVABILITY PROOF OF THE0REM[2} SUM-RATE FOR < p < 0.5 

In this appendix, we provide the achievability proof of Theorem |2] with Delayed-CSIT and for < p < 0.5. We 
provide the an achievability strategy for rate tuple 

i?i = i?2 = min L, , , 1^ ~ ] ■ (89) 



l + (l-g2)-lp 

Let the messages of transmitters one and two be denoted by Wi = oi, 02, • . . , dm, and W2 = bi,b2, ■ . ■ ,bm, 
respectively, where a^'s and 6j's are picked uniformly and independently from {0, 1}, i = 1, . . . , m. We show that 
it is possible to communicate these bits in 



n 



max|m/p, (1 - ^ m + (l - g^) prri^ + O (^m^^^^ (90) 



time instants with vanishing error probability (as m — )• 00). Therefore achieving the rates given in ( 89 1 as m — )• 00. 

Phase 1 [uncategorized transmission]: At the beginning of the communication block, we assume that the bits at 
Txj are in queue Qi^i, i = 1, 2. At each time instant, Txj sends out a bit from Qi^i and this bit will either stay 



in the initial queue or a transition to a new queue will take place. Table III summarizes the transitions for each 
channel realization. The arguments are very similar to our discussion in Section [Vj and the only difference is the 
way we handle Cases 7, 8, 11, and 12. We provide some details about these cases. 

For Cases 7 (/^) and 8 (^), in Section |vj we updated the status of the transmitted bit of Tx2 to (52^{i,2}- 
However, this scheme is suboptimal for < p < 0.5, and instead we update the status of the transmitted bit of 
Tx2 to an intermediate queue Q2,int- Then in Phase 2, we retransmit these bits and upgrade their status once 
more. Similar story holds for Cases 11 and 12. The main reason for doing this is as follows. As we discussed in 



Section IV there are many opportunities to combine bits in order to improve the achievable rates. However, we 
could never combine the bits that were transmitted in Cases 7, 8, 11, or 12 with other bits. This was not an issue for 
0.5 < p < I, however for < p < 0.5, we need to find a way to combine these bits with other bits in future time 
instants. To do so, the only way is to keep them in an intermediate queue and retransmit them again in Phase 2. 
Phase 1 goes on for 

(l-g2)"^m + mi (91) 
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TABLE in 

Summary of Phase 1 for the Achievability Scheme of Corner Point B. Bit "a" represents a bit in Qi^i while bit "6" 

REPRESENTS A BIT IN Q2^2. 



case ID 


channel realization 
at time instant ti 


state transition 


case ID 


channel reaUzation 

at time instant n 


State transition 


1 


Txi Rxi 


J a (5i,ci 

\ Q2.C1 


9 


Txi Rxi 

am • 


\ Q2.F 










,'1 • /) 




2 


Is, Rxi 

o W^;- a 


J O^Qn.2|l 
16^ Q2,F 


10 


Txi Rxi 

a • y,* b 


J a ->■ Ql-^l 

\ Q2,F 




b -nMt a*b 






b 9^ 1^ b 




3 


Txi Ibti 
• a + b 


( a^Qi,F 
\ 6 Q2-H12 


11 


Tx, Rxi 

a m^ • 


( a ^ Qi,iNT 

\ b^ Q2,F 




^ T~ ^ ^ 






b • a*b 




4 


Txi Rxi 

b 9 *m b 


J a Qi,F 

I b^Q2,F 


12 


Tx| Rxi 

b 9^ a*b 


r QijNT 

\ b^ Q2,F 




Tic, Bjtj 






Tx, Rx, 




5 


b • • 


J a -)■ (3i,F 

\ 6 ^ Q2->2 


13 


Txi Rxi 
a • yr« b 

b 


r a -)■ Qi^i 

\ 6 Q2^.2|l 


6 


Txi Rxi 

a ^ o 

I) • 


J a Qi,F 


14 


Txi Rxi 

a •i • 

h m a 


J a ^ Qi^i|2 


7 


a • yt» a-'b 

b • 

Tx-, Rxa 


J a -)■ (5i,F 

[_ 6 — >^ Q2,INT 


15 


Txi Itxi 
Txj Rx, 


J a-^Qn.i|2 

\ b-^Q2^2\l 


8 


Txi Rxi 


J a Qi.F 

!_ 6 — >■ Q2,INT 


16 


Txi Rxi 

am m 
b • • 

Tx, Rx, 


J a — >• Qi^i 

\ 6 -> Q2^2 



time instants and if at the end of this phase either of the queues Qi^i is not empty, we declare error type-I and 
halt the transmission. 

Assuming that the transmission is not halted, upon completion of Phase 1, we have 

y],_ii 19 Pr (Case j) „ , „ 

miJNT] = 1 V PrfCasen "^ = " « )^ ^^m, (92) 

~ 2^1=9,10,13,16 I'^ase ij 
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similarly, we have 



l-Ei=9,mi3,i6Pr(Casei) 



„r 1 Pr (Case 1) , ^ a 

Pr (Case 3) / 9n i 

-m = (1 - r'^^ 

36 i) 

y'^-iq ip: Pr (Case j) „ , „ 

1 - Ei=9,io,i3,i6 (Case i) 

y],-? o Pr (Case j) „ , „ 

m^JNT] = , f^^-''^ Pr(Caseir = " ^ ) (^3) 
^ ~ 2^1=9,10,13,16 V^^S^ ^> 



If the event 



N > E,[N] + ma for = Ni^c^, N^^^J, A'j_j.j|j, NijNT, i = 1,2, occurs, we consider it as error 
type-II and we halt the transmission strategy. At the end of Phase 1, we add O's (if necessary) in order to make 
queues Qi^Ci, Qi^j\J' ^rid QijNT of size equal to ¥.[Ni^c^]+mi , E[A^j_5.j|j]+m3, and ¥.[NijjqT\+'ma respectively, 
i = 1,2, and j = i, i. Furthermore, using Chemoff-Hoeffding bound, we can show that the probability of errors of 
types I and II decreases exponentially with m. 

Phase 2 [upgrading status of interfering bits in Qi^c Y- In this phase, we focus on the bits in Qijnt and Q2,int- 
At each time instant, Txj picks a bit from Qijnt and sends it. This bit will either stay in QijNT or a transition to 



a new queue will take place. Table IV describes what happens to the status of the bits if either of the 16 possible 
cases occurs. Due to symmetry, we only describe the transitions for bits in Qijnt- Consider bit "a" in Qijnt- 

• Cases 1,2,3,4, and 5: The transitions for these cases are consistent with our previous discussions. 

• Cases 9, 10, 11, 12, 13, and 16: In these cases, it is easy to see that no change occurs in the status of bit a. 

• Case 6: In this case, bit a is delivered to both receivers and hence, no further transmission is required. Therefore, 
it joins Qi^F- 

• Case 7: Here with slight abuse of, Qi,Ci represents the bits of Txi that are received at both receivers with 
interference but not necessarily in Case 1, i = 1, 2. For instance if at a given time, Txi sends a bit from Qijnt 
and Case 7 occurs, then this bit joins Qi^Ci since now both receivers have received this bit with interference. 

• Case 8: In this case, bit a is available at Rx2 but it is interfered at Rxi by bit b. However, in Case 8 no 
change occurs for the bits in Q2.int- Therefore, since bit b will be retransmitted until it is provided to Rxi, 
no retransmission is required for bit a and it joins Qi^f- 

• Cases 14 and 15: If either of these cases occur, bit a becomes available at Rx2 and is needed at Rxi. Thus, 
we update the status of such bits to (5i_>i|2- 

Phase 2 goes on for 

1— Pr (Case i) j (l — g^) ^p'^qm + 2mi 

4=9,10,11, 12, 13, 16 j 
= (l - [p^q + q^]y^ [l- q^) p^qm + 2ml (94) 

time instants and if at the end of this phase either of the states QijNT is not empty, we declare error type-I and 
halt the transmission. 

Assuming that the transmission is not halted, upon completion of Phase 2, the states Qijnt and Q2,int are 
empty and we have 

m^,C^ = (1 - q'rVm + ^^='''^'^^'^'^] {p\m + m^/^) 

^ ~ Z^i=9,io,ii,i2,i3,i6 l^^ase ij 

= (1 - +{l-[p^q + q^])~^ (p^ + p^q^) (p^qm + m^/^^ , (95) 
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TABLE IV 

Summary of Phase 2 for the Achievability Scheme of Corner Point B. Bit "a" represents a bit in Qijnt while bit "b" 

REPRESENTS A BIT IN Q2,INT. 



case ID 



channel realization 
at time instant n 



state transition 



case ID 



channel realization 
at time instant n 



state transition 




o. Ql.Ci 

b Q2,ci 



a — >■ Qi,iNT 

b Q2-).l|2 



a — (5i-»2|i 

b Q2,F 



10 




a — QijNT 

b Q2,F 




a — >■ Qi,F 

b Q2^1\2 



11 




a — > Qi,iNT 
b Q2,Ci 



a — ^ Qi^.2|i 

b — Q2^1|2 



12 




a — QijNT 

b Q2,F 



a — >■ Qi_^2|i 

6 — Q2,INT 



13 




a — >■ Qi,iNT 

b Q2^2|l 




& — > Q2,INT 



14 




a — >• Qi^i|2 

& — > Q2,INT 




a Qi,ci 

& — ^ Q2,INT 



15 




a ^ Qi-n|2 

& — ^ Q2^.2|l 




& — >■ Q2,INT 



16 



a — >■ Qi,iNT 

b — > Q2,INT 



similarly, we have 



and 



E[Ar, 



(1- 

(1- 

= (1 

= (1 



Ei=2,4,5 (Case j) 



q ) p qm+— . 

2^1=9,10,11,12,13,16 -'^^'^ l'^^^® V 

q^)~^p^qm + (l — [p^g + ) ^ (p^Q' + P^^^) [p^qm + m^/^^ , 



(96) 



Ej=i4,i5 (Case j) 
Ei=9,io,ii,i2,i3,i6 P^ (Case i 
q^)^^pq^m + (l — [p'^q + q'^]) ^ pq^ (^p^qm + m^^^^ 



(97) 



If the event 



AT > E[N] + ml 



for A'" = A^j Ci, ^t^t|i, ^ = 1,2, occurs, we consider it as error type-II 
and we halt the transmission strategy. At the end of Phase 2, we add O's (if necessary) in order to make queues 
(5i,Ci and Qi^j\j of size equal to EfA'j^Ci] + "^^^ and E[N^^j^j] + ms respectively, i = 1,2, and j = Using 
Chemoff-Hoeffding bound, we can show that the probability of errors of types I and n decreases exponentially 
with m. 

Phase 3 [encoding and retransmission]: In this phase, Txj communicates the bits in Qi^i\i to Rxj, i = 1, 2. However, 
it is possible to create XOR of these bits with the bits in Qi^i^i and the bits in Qi^Ci to create bits of common 
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interest. To do so, we first encode tiie bits in these states using the results of |27|, and then we create the XOR of 
the encoded bits. 

In other words, given e,6 > 0, Txj encodes all the bits in Qj_^ju at rate p — 6 using random coding scheme 



of |27|. Similarly, Tx, encodes q lK[N^^^j] +m3 J bits from and Qi,Ci at rate pq — S (if there are less 



bits m Qi^i\i and (5j,Ci> then encode all of the bits in these queues). More precisely, first Txj encodes bits from 

Qi^i\i, and if the number of bits in Qi^i\i is less than q ^E[A'j_^j|j] + ms^, then Txj uses bits in Qj^Ci- Txj will 
then communicate the XOR of these encoded bits. 

Note that since Rxj already knows the bits in Q^^-^\^, it can remove the corresponding part of the received signal. 
Then since the channel from Tx^ to Rxj can be viewed as a binary erasure channel with success probability of 
pq, from |27|, we know that Rx, can decode QiCi with decoding error probability less than or equal to e. Thus, 
Rxj can decode the transmitted bits from QjCi use them to decode the bits in Qi^Ci- Then, Rxj removes the 
contribution of the bits in Qj,Ci the received signal. Finally, since the channel from Txj to Rxj can be viewed as a 
binary erasure channel with success probability of p, from [27], we know that Rxj can decode Qi^i^j with decoding 
error probability less than or equal to e. 

If an error occurs in decoding of the encoded bits, we halt the transmission. Assuming that the transmission is 
not halted, at the end of Phase 3, Qi^i\i becomes empty and there are 

(E[iV,^j|,] + E[iVi,c,] + 2ml-q (e[N,^,^^ + mi))^ (98) 

bits left in and (5j,Ci- 

If Qi^i\i and Qi,Ci are also empty, the transmission strategy ends here. Otherwise, we merge the remaining bits 



in Qi^i\i (if any) with the bits in <5i,Ci as Type-Ill (see Section IV i and put the XOR of them in Qi^{i,2}> ^ = 1)2. 
Finally, we need to describe what happens to the remaining bits m Qi^Ci- As mentioned before, a bit in Qi^Ci can 
be viewed as a bit of common interest by itself. For the remaining bits in Qi^Ci, we put the first half in (5i_>{i^2} 
(suppose m is picked such that the remaining number of bits is even). Note that if these bits are delivered to Rx2, 
then Rx2 can decode the first half of the bits in Q2,Ci- Therefore, the first half of the bits in Q2,Ci join Q2,f- 
Phase 4 [communicating bits of common interest]: During Phase 4, we deliver the bits in Qi^{i^2} (52-s>{i,2} 
using the transmission strategy for the two-source multicast problem. More precisely, the bits in Qi^{i^2} will be 
considered as the message of transmitter Txj and they will be encoded as in the achievability scheme of Lemma |2] 
i = 1,2. Fix e,6 > 0, from Lemma |2] we know that the rate tuple 

(iil,i?2) = ^((l-g')-5,(l-g')-5) 

is achievable with decoding error probability less than or equal to e. Thus, using Lemma [2| we can communicate 
the remaining bits at rate {1 — q'^) — 6 with decoding error probability less than or equal to e. If an error occurs in 
decoding of the encoded bits, we halt the transmission. 



Using Chernoff-Hoeffding bound and the results of |27|, we can show that the probability that the transmission 



strategy halts at any point approaches zero for e, 5 — >• and m ^ oo. Moreover, it is easy to verify that for 
< p < (3 — \/5) /2, at the end of Phase 3, Qi^i\i and Qi.Ci are empty and the transmission strategy ends there. 
However, for (3 — \/5) /2 < p < 0.5, the transmission strategy continues to Phase 4. Therefore, we can show that 
if no error occurs, the transmission strategy end in 

n = max |m/p, (l — g^) ^ m + (l — q^) ^pm| + O ^m^''^^ (99) 

time instants. Therefore achieving the rates given in ( [89| ). 

Appendix D 

Achievability Proof of Theorem[2J Corner Point C 
In this appendix, we describe the achievability strategy for corner point C depicted in Figure [iTjb), i.e. 

iRi,R2) = {pqil + q),p). (100) 
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TABLE V 

Summary of Phase 1 for the Achievability Scheme of Corner Point C. Bit "a" represents a bit in Qi^i while bit "6" 

REPRESENTS A BIT IN Q2^2- 



case ID 


channel realization 
at time instant n 


state transition 


case ID 


channel realization 
at time instant n 


State transition 


1 


.. .„. 

h a*h 




I a Qixi 

I b^Q2,F 


9 


Txi Rxi 
• • 




J a — !> Qi^i 

I b^Q2,F 




b m >• J, 

Tx^ Rx^ 


2 


Txi Rxi 


\ 


a. — ^ Qi.OP 

, b Q2,F 


10 


Txi Rxi 

b 




J a ^ Qi^i 
1 b Q2,F 


Tx. Rx. 


Tx^ Rx^ 


3 


Txi Rxi 

b •''^'^^^^^^^ >• b 


\ 


a — ^ 
. b (52, OP 


11 


Txi Rxi 

a •v • 

b • — »• a*b 


{ 


a — >■ Qi,iNT 

b Q2,F 


Tx. Rx, 


Txj Rx^ 


4 


Tx| Rx| 

b % >% b 




J a — > (5i,F 

1 & ^ Q2,F 


12 


Tx| Rx| 


{ 


b Q2,F 


Tx, Rx, 


Tx, R.x, 


5 


Tx| Rx| 

b • • 

Tx, Rx, 




I a ^ yi J 

I b Q2^2 


13 


Txi R.X| 

a • b 
b • 

Txj Rs, 


\ 


o — > yi^i 

. b Q2^2\l 


6 


Tx| Rx| 

a fr;- *• a 

b • a 




I a Qi^F 

[ b Q2^2 


14 


Txi Rxi 

b • a 


\ 


a — >• yi^i|2 

. b Q2^2 


7 


Txi Rxi 

a • a + b 

b • 

Tx, Rx, 


{ 


a. — > Qi,F 

b — >■ Q2,INT 


15 


Txi Rsi 

.XX „ 

Tx, Rx, 


{ 


a — >• (5i^i|2 

, & Q2-^2|l 


8 


Txi Rxi 
Tx, Rx, 


{ 


a. — > Qi,F 

b — >■ Q2,INT 


16 


Txi Rsi 

a • • 

/> • • 

Tx; Rx, 




( a ^ Qi^i 
\ b Q2^2 



Let the messages of transmitters one and two be denoted by Wi = ai, a2, . . . , Umi, and W2 = 61, 62, • • • , ^m, 
respectively, where data bits a^'s and 6j's are picked uniformly and independently from {0, 1}, and mi = g(l + g)m 
(suppose the parameters are such that m, mi G Z). Note that for (3 — \/5) /2 < p < 1, we have q{l + q) < 1. We 
show that it is possible to communicate these bits in 

n = X + O (^m^/^) (101) 

time instants with vanishing error probability (as m — )• 00). Therefore, achieving comer point C as m — )• cxd. Our 
transmission strategy consists of five phases as described before. 

Phase 1 [uncategorized transmission]: This phase is similar to Phase 1 of the achievability strategy for the optimal 
sum-rate point A. The main difference is due to the fact that the transmitters start with unequal number of bits. At the 
beginning of the communication block, we assume that the bits ai, 02, . . . , at Txi and the bits 61, 62, • • • , 
at Tx2 are in queues Qi-^i and Q2^2 respectively. 

Remark 17: Note that Tx2 has m initial bits, however, only mi of them are in Q2^2 at the beginning of the 
communication block. 

At each time instant t, Txj sends out a bit from Qi^i, and this bit will either stay in the initial queues or a 
transition will take place. Based on the channel realizations, a total of 16 possible configurations may occur at any 
time instant. Table |V] summarizes the transition from the initial queue for each channel realization. 

In comparison to the achievability strategy of the sum-rate point A, we have new queues for the bits: 
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1) Qi,OP denotes the bits that have caused interference at the unintended receiver and this interference has to 
get resolved. 

2) Qi.iNT denotes an intermediate queue of the bits at Txi that were transmitted when channel realizations 11 
or 12 occurred. 

3) Qi,iNT denotes an intermediate queue of the bits at Tx2 that were transmitted when channel realizations 7 
or 8 occurred. 

Phase 1 goes on for 

2 

{1/p — 1) m -\r 7713 (102) 

time instants and if at the end of this phase, either of queues Qi^i is not empty, we declare error type-I and halt 
the transmission. 

Assuming that the transmission is not halted, let random variable A'^i,Ci> -^i,OP> ^^d Ni^i^T denote the 

number of bits in (3i,Ci> Qi,OP^ Qi^i\i, and Qijnt respectively i = 1,2. The transmission strategy will be halted 
and an error (that we refer to as error type-II) will occur, if any of the following events happens. 

iVi,Ci > K[iVi,cJ + mi = ni,^; Ni^op > K[A^i,op] + mi = m^op, i = 1, 2;Ari^i|i > K[Ni^^-] + mi = n^^i,-, 

(103) 

From basic probability, and we have 

^ ~ Z^i=9,io,i3,i6 I'^ase 1) 

J- ~ 2^1=9,10,13,16 (>^ase ij 

IE[iV2,Op] = ^ ^"^1 = (1 - t) Vgmi = p^q'm, 

J- ~ Z^i=5,6,i4,i6 (.i^ase ij 

^^^^ = ^=''^''^"%""jl., rn, = (1 - {pq'+pV) -1 = 5^-, ^ = 1,2, 

^ ~ 2^1=9,10,13,16 l^ase ij 

nN.jNT] = , ^i=ii.i2Pr(Case j) ^ _ {p\ + p\^) mi = pq^m, i = 1,2. (104) 

J- - 2^j=9,io,i3,i6 [^ase 1) 

Furthermore, using Chernoff-Hoeffding bound, we can show that the probability of errors of types I and II 
decreases exponentially with m. 

At the end of Phase 1, we add O's (if necessary) in order to make queues Qi,Ci> Qi,OP^ Qi^i\i, and QijNT 
of size equal to ni Ci, ni^op^ "^i-^i^i^ ^^d riij^T respectively as defined in (103 1, z = 1,2. For the rest of this 
appendix, we assume that Phase 1 is completed and no error has occurred. 

Phase 2 [updating status of the bits in QijNT]'- In this phase, we focus on the bits in QijNT, i = 1,2. The 
ultimate goal is to deliver the bits in Qijnt to both receivers. At each time instant, Txj picks a bit from Qijnt 
and sends it. This bit will either stay in QijNT or a transition to a new queue will take place. Table VI describes 
what happens to the status of the bits if either of the 16 cases occurs. 

Here, we describe what happens to the status of a bit in Qijnt if either of the 16 channel realizations occur. 
The description for a bit in Q2,int is very similar and is summarized in Table VI Consider a bit "a" in Qijnt- 
At each time instant, 16 possible cases may occur: 

• Cases 9,10,11,12,13, and 16: In these cases, it is easy to see that no change occurs in the status of bit a. 

• Case 6: In this case, bit a is delivered to both receivers and hence, no further transmission is required. Therefore, 
it joins Qi^F- 

• Case 8: In this case, bit a is available at Rx2 but it is interfered at Rxi by bit b. However, in Case 8 no 
change occurs for the bits in Q2.int- Therefore, since bit b will be retransmitted until it is provided to Rxi, 
no retransmission is required for bit a and it joins Qi^f- 

• Cases 14 and 15: If either of these cases occur, bit a becomes available at Rx2 and is needed at Rxi. Thus, 
we update the status of such bits to Qi^i|2- 
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TABLE VI 

Summary of Phase 2 for the Achievability Scheme of Corner Point B. Bit "a" represents a bit in Qijnt while bit "b" 

REPRESENTS A BIT IN Q2,INT. 



case ID 



channel realization 
at time instant n 



state transition 



case ID 



channel reaUzation 
at time instant n 



state transition 




o. Ql.Ci 
b Q2,F 



a — >■ Qi,iNT 
b Q2,op 




a —J- Qi,op 
b — >• Q2,op 



10 




a — ^ QijNT 

b Q2,F 




a — >■ Qi,Ci 
b Q2,op 



11 




a — > Qi,iNT 
b Q2,op 



a —J- Qi,op 
b Q2,op 



12 




a — QijNT 

b Q2,F 



a — > Qi,op 

b Q2,INT 



13 




a — >■ Qi,iNT 

b Q2^2\l 




a — >■ Qi,F 

b — > Q2,INT 



14 




a — >■ (3i^i|2 

& — > Q2,INT 




a Qi,op 

b Q2,INT 



15 




a Qn.i|2 

6 — ^ Q2^.2|l 




& — >■ Q2,INT 



16 



a — >■ QijNT 

b — > Q2,INT 



• Cases 1,2,3,4,5, and 7: If either of these cases occur, we upgrade the status of bit a to the opportunistic state 
Qi,OP^ meaning that from now on bit a has to be provided to either Rx2 or both receivers such that it causes 
no further interference. For instance, if Case 2 occurs, providing bit a to both receivers is suffiecient to decode 
the simultaneously transmitted bits. 

Phase 2 goes on for 

(l - [p^q + 2pq^ + <i^]y^ PQ^'rn + 2mt (105) 

time instants, and if at the end of this phase either of the states Qijnt is not empty, we declare error type-I and 
halt the transmission. 

Assuming that the transmission is not halted, since transition of a bit to this state is distributed as independent 
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Bernoulli RV, upon completion of Phase 2, we have 

o V o Pr (Case j) „ „,„ 

^ ~ Z^j=9,io,ii,i2,i3,i6 I'^ase ij 
= p^gm + (l - [p^q + 2pg^ + q'^])~^ p^{pq^m + m^/^), 
IE[A^i,Op] = p^q^m + (l - [p^g + 2pg^ + q^])~^ pq{pq^m + m^/^), 
IE[A^2,0P] =p^q^m+ (l - [/g + 2pg2 + g4j^-ip^^-^ + /)(pgV + m^/^), 

= q''m+{l- [p\ + 2p<72 + g^] ) / 2 ^ ^2/3\ ^ • ^ 2. (106) 



The transmission strategy will halt and an error (that we refer to as error type-II) will occur, if any of the 
following events happens. 

7Vi,Ci >E[iVi_cJ + mi =ni,ci; Ni^op > ^[Ni,op] + ml =ni,oP, i = l,2;Ni^^j > E[Ni^i\-] + ml = n^^^, 

(107) 

Using Chernoff-Hoeffding bound, we can show that the probability of errors of types I and II decreases expo- 
nentially with m. 

Again, at the end of Phase 2, we add O's (if necessary) in order to make queues Qi,Ci> Qj,OP> and Qi^i^j of 
size equal to rii Ci, rii^op^ and nj_^j|j respectively as defined in (107i, i = 1,2. For the rest of this appendix, we 
assume that Phase 2 is completed and no error has occurred. 

Note that Tx2 initially had m fresh data bits but during Phase 1 it only communicated mi of them. The rest of 
those bits will be transmitted during Phase 3 as described below. 

Phase 3 [uncategorized transmission vs interference management]: During Phase 3, Txi (the secondary user) 
communicates — q^)m bits from states Qi,Ci and Qi^op at a rate such that both receivers can decode them 

at the end of Phase 3, regardless of the transmitted signal of Tx2. In fact, at Rxi, we have 

Pr[Gii[t] = l,G2iM = 0]=pg, (108) 

and at Rx2, we have 

Pr[G22[t] =0,Gi2M = 1] =M- (109) 

Hence, using the results of fTl\, we know that given any e, (5 > 0, Txi can use a random code of rate pq — 5 to 
encode ]j^{p — q'^)m bits from states Qi.Ci and (5i,OP> and transmits them such that both receivers can decode 
the transmitted message with error probability less than or equal to e for sufficiently large block length (Txi picks 
bits from (5i,Ci and if this state becomes empty it starts picking from the bits in Qi.op)- Since Rx2 can decode 
the transmitted signal of Txi in this phase, we can assume that the encoded bits of Txi, do not create any new 
interference during Phase 3. 

We now describe what Tx2 does during Phase 3. At the beginning of Phase 3, we assume that the bits 
bmi+i,bmi+2, ■ ■ ■ ,bm. at Tx2 are in state Q2^2- At each time instant, Tx2 picks a bit from Q2-^2 and sends 
it. This bit will either stay in Q2^>2 or a transition occurs as described below. 

• Cases 1,2,3,4,9, 10, 11, and 12: In these cases the direct link from Tx2 to Rx2 is on. Therefore, since at the 
end of block (assuming large enough block length), we can decode and remove the transmitted signal of Txi, 
the transmitted bit of Tx2 leaves Q2^2 and joins Q2,p- 

• Cases 7, 8, 13, and 15: In these cases (assuming the transmitted signal of Txi can be removed), the transmitted 
bit of Tx2 becomes available at Rxi while it is required at Rx2. Thus, the transmitted bit of Tx2 leaves Q2^2 
and joins (52^2|i- 

• Cases 5, 6, 14, and 16: In these cases, no change hanppens in the status of the transmitted bit from Tx2. 
Phase 3 goes on for 

(v — o^) 2 

; % m + m3 (110) 

(1 -r) 
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time instants and if at the end of this phase there is a bit left in (^2^2 or an error occurs in decoding the transmitted 
signal of Txi, we declare error type-I and halt the transmission. Note that during Phase 3, the number of bits in 
Qi->i|2 ^nd Q2,oP remain unchanged. 

Assuming that the transmission is not halted, since transition of a bit to this state is distributed as independent 
Bernoulli RV, upon completion of Phase 2, we have 



E[iVi,cJ 
K[iVi,Op] 



p^qm + (1 — [p^q + 2pq^ + 9^] ) ^ p'^{pq^m + m^/^) 



1 + 



-{p 



p q m + (1 



1 + 



[p^q + 2pq^ + 9^] ) ^ pq{pq^m + m^^^) 

[l - [p^q + 2pq^ + q'^])'^ p^{pq'^m + m^/^) 



3 

p qm 



(111) 



For (3 — \/5) /2 < p < 1, ¥,[Nifip\ is non-negative. The transmission strategy will halt and an error (that we 
refer to as error type-II) will occur, if any of the following events happens. 

1) iVi,c, >E[A^i,cJ+mf;^ 

2) iVi,op > ^[Ni^op\+mi-^ 

3) N2^2\i > E[iV2^2|i] + "lo- 
using Chernoff-Hoeffding bound, we can show that the probability of errors of types I and II decreases expo- 
nentially with m. 

Phase 4 [delivering interference-free bits and interference management]: In Phase 4, Txi will communicate all the 
bits in Qi^i|2- However, it is possible to create XOR of these bits with bits in Qi.op in order to create bits of 
common interest. To do so, we first encode the bits in these states using the results of |27t , and then we create the 
XOR of the encoded bits. On the other hand, Tx2 will do the same to part of the bits in Q2^2\i ^nd Q2,OP- 

More precisely, for any e,S > 0, Txi encodes all the bits in (5i-s>i|2 rate p — 5 using random coding scheme 
of p7| . Similarly, Txi encodes 

q^+{l-[p^q + 2pq'^ + q^]y\'^q^ (112) 

bits from Qi^op at rate pq — 6. Then Txi will communicate the XOR of these encoded bits. 

During Phase 3, Tx2 encodes same number of the bits as in Qi_s>i|2 from Q2^2\i rate p — 6 and 



q'+{l-[p\ + 2pq^ + q'])-'p'q' 



bits from Q2,oP at rate pq — 5 using random coding scheme of |27| . Then Tx2 will communicate the XOR of these 
encoded bits. 

Since Rx2 already has access to the bits in Qi_j>i|2 and (52,OP> it can remove their contribution from the received 
signals. Then for sufficiently large block length, Rx2 can decode the transmitted bits from Qi.op with decoding 
error probability less than or equal to e. After decoding and removing this part, Rx2 can decode the encoded bits 
from (52-s>2|i with decoding error probability less than or equal to e. 

On the other hand, since Rxi already has access to the bits in (32->2|i and Qi,oP> it can remove their contribution 
from the received signals. Then for sufficiently large block length, Rxi can decode the transmitted bits from Q2,oP 
with decoding error probability less than or equal to e. Finally, after decoding and removing this part, Rxi can 
decode the encoded bits from Qi^i\2 with decoding error probability less than or equal to e. 

Phase 4 goes on for 

q^m + (1 - [p^q + 2pq^ + q^])'^ 



pq 



pq^ + m^^^ 



Kp-^) 



(113) 



time instants. If an error occurs in decoding any of the encoded signals in Phase 4, we consider it as error and we 
halt the transmission strategy. 

At the end of Phase 4, Qi^i\2 becomes empty. Define 



13 = {pq - 6) q^m + (l - [p^q + 2pq^ + <f\) ^ P'f (p'f + "^^^^ 



/ip-^), 



(114) 



note that as e, 5 — )• 0, /3 agrees with the expression given in (112 1. 
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Upon completion of Phase 4, we have 




1 



pq{pq^m + m^^^) 

[p^q + 2pq^ + q'^]y^ p^{pq^m + rr?!'^) 
pq{l + p'^){pq^m + m^'''^) — /3, 



+ 



1 + g 



(p - q^)m - /3, 




p q m + 



[p^q + 2pq^+q^]) 




(115) 



The transmission strategy will halt and an error of type-II will occur, if any of the following events happens. 



Using Chemoff-Hoeffding bound, we can show that the probability of errors of type II decreases exponentially 
with m. Furthermore, the probability that an error occurs in decoding any of the encoded signals in Phase 4 can 
be made arbitrary small as m — oo. 

Phase 5 [delivering interference-free bits and interference management]: In Phase 5, the transmitters will commu- 
nicate the remaining bits in Qi^p, Qi.Ci, <52-s>2|i> and Q2,OP- Txi will communicate all the bits in Qi^op and 
Qi Ci such that for sufficiently large block length, both receivers can decode them with arbitrary small error. On 
the other hand, Tx2 will communicate the bits in (52-s>2|i and Q2,oP similar to Phase 4 with one main difference. 
Since both receivers can completely remove the contribution of Txi at the end of the block, Tx2 can send the bits 
in Q2,OP at a higher rate of p as opposed to pq during Phase 4. 

More precisely, for any e,5 > 0, Txi using random coding scheme of fTJ], encodes all the bits in Qi.op and 
Qi^Ci at rate pq — 6 and communicates them. On the other hand, Tx2 using random coding, encodes all the bits in 
(52-s>2|i and all bits in Q2,oP at rate p — 6. Then, Tx2 communicates the XOR of its encoded bits. 

Since Rxi already has access to the bits in Q2^2\i and Qi,oP> it can remove the corresponding parts of the 
transmitted signals. Then for sufficiently large block length, Rxi can decode the transmitted bits from Qi,Ci and 
Q2,OP with decoding error probability less than or equal to e. 

Finally, since Rx2 already has access to the bits in Q2,OP> it can remove the corresponding part of the transmitted 
signal. Then for sufficiently large block length, Rx2 can decode the transmitted bits from Qi^op and Qi^Ci with 
decoding error probability less than or equal to e. After decoding and removing this part, Rx2 can decode the 
encoded bits from Q2-s>2|i with decoding eiTor probability less than or equal to e. 

Phase 5 goes on for 



time instants. If an error occurs in decoding any of the encoded signals in Phase 5, we consider it as error and 
halt the transmission strategy. It is straight forward to verify that at the end of Phase 5, if the transmission is not 
halted, all states are empty and all bits are successfully delivered. 

The probability that the transmission strategy halts at any point can be bounded by the summation of error 
probabilities of types I-II and the probability that an error occurs in decoding the encoded bits. Using Chernoff- 
Hoeffding bound and the results of (Tl], we can show that the probability that the transmission strategy halts at 
any point approaches zero for e, (5 — >• and m — )• oo. Moreover, the total transmission requires 



1) Ni^op > HNtop] + mi, i = 1, 2; 

2) iV2^2|l >E[iV2^2|i]+mi. 




(116) 



1 



m 



(117) 



p 



time instants. Thus, Txi achieves a rate of pq{l + q) while Tx2 achieves a rate of p. 
This completes the achievability proof of Theorem [2] 



Appendix E 
Proof of Lemma[2] 

In this appendix, we provide the proof of Lemma [2] We first derive the outer-bound and then we describe the 
achievability. The outer-bound on Ri is the same as in Section [B] 
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Suppose there are encoders and decoders at the transmitters and receivers respectively, such that each receiver 
can decode both messages with arbitrary small decoding error probability as the block length goes to infinity. We 
have 



n{Ri +R2- en) 

< /(T¥i,W^2;n"|G") 
H{Y^\G'') - H{Y^\WuW2,G'') 



i/(yi"|G") 

< ^H{Y^[t]\Gn 
t=i 

<{l-q^)n, (118) 

where e„ — )• as n — )• 00; and (a) follows from the fact that the messages and are mutually independent, 
Fano's inequality, and the fact that Rxi should be able to decode both messages; (6) holds since the received signal 
y" is a deterministic function of Wi, W2, and G"; and (c) follows from the fact that conditioning reduces entropy. 
Dividing both sides by n and let n — )• 00, we get 

Ri + R2<l-q'^- (119) 



Below, we provide the achievability proof of Lemma [2] Let Wj G {1, 2, . . . , 2"^'} denote the message of user i. 

In p7| , it has been shown that for a binary erasure channel with success probability p, and for any e,d > 0, as 
long as the communication rate is less than or equal to p — 6, we can have decoding error probability less than or 
equal to e. 

Codebook generation is as follows. Transmitter i creates 2"^* {Ri = p — 6 and R2 = pq — S) independent 
codewords where each entry of the codewords is an i.i.d. Bernoulli 0.5 RV. For message index j, transmitter i 
will send the j*'* codeword. Note that we can view the channel from Tx2 to Rxi as a binary erasure channel with 
success probability pq (whenever = and G2i[t] = 1, we get a clean observation of X2[t]). Therefore, since 

R2 = pq — 6, Rxi can decode W2 with arbitrary small decoding error probability as n — )• 00 and remove X2 from 
its received signal. After removing X2, we can view the channel from Txi to Rxi as a binary erasure channel with 
success probability p (whenever Gii[t] = 1, we get a clean observation of Xi[t]). Therefore, since Ri = p — 6, 
Rxi can decode Wi with arbitrary small decoding error probability as n — )• 00. Similar argument holds for Rx2. 
This completes the achievability proof of corner point 

{Ri,R2) = ip,pq). (120) 

Similarly, we can achieve comer point 

{Ri,R2) = {pq,p). (121) 
Therefore with time sharing, we can achieve the entire region as described in Lemma |2] 

Appendix F 

Achievability Proof of Theorem [sj Corner Point (l - g^, O) 
By symmetry, it suffices to describe the achievability strategy for corner ponit 

(i?i,i?2) = (l-g2,0) , (122) 

when transmitters have delayed knowledge of channel state information and noiseless output feedback links are 
available from the receivers to the transmitters. 

Our achievability strategy is carried on over 6 + 1 communication blocks each block with n time instants. 
Transmitter one communicates fresh data bits in the first b blocks and the final block is to help receiver one 
decode its corresponding bits. Transmitter and receiver two act as a relay to facilitate the communication between 
transmitter and receiver one. At the end, using our scheme we achieve rate tuple (l — g^, O) as n — )• 00. Finally, 
letting 6 — cx), we achieve the desired comer point. 
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Let W{ be the message of Txi in block j, j = 1,2, . . . ,b. We assume W-[ = a-J, Cg, • • • , a™- We set 

n = (l - g2)-^TO + ^2/3_ (123) 

Achievability strategy for block 1: At the beginning of the communication block, we assume that the bits at 
Txi are in queue (or state) Q\^i- At each time instant t, Txi sends out a bit from Q\^i, and this bit will leave 
this queue if at least one of the outgoing links from Txi was equal to 1 at the time of transmission. On the other 
hand, Tx2 remains silent during the first communication block. If at the end of the communication block, queue 
Q\-).i is not empty, we declare error type-I and halt the transmission. 

At the end of first block, using output feedback links, transmitter two has access to the bits of Txi communicated 
in the first block. More precisely, Tx2 has access to the bits of Txi communicated in Cases 11, 12, 14, and 15 
during the first communication block. Note that the bits communicated in these cases are available at Rx2 and have 
to be provided to Rxi. Transmitter two transfers these bits to Q2->x|2- 

Assuming that the transmission is not halted, let A'^^_j.^|2 denote the number of bits in queue (52-s>i|2- "^^^ 
transmission strategy will be halted and an error type-II will occur, if A^2-^.i|2 ^ ^[^2-^•l|2] From basic 

probability, we know that 

^ ~ Z^i=9,io,i3,i6 I'^ase ij 

Using Chemoff-Hoeffding bound, we can show that the probability of errors of types I and II and decreases 
exponentially with m. 

Achievability strategy for block j, j = 2,3, . . . ,b: In the communication block j, Tx2 treats the bits in Q2^>\|2 
as its message and it uses a random code of rate pq — 6 to transmit them. Note that the channel from Tx2 to Rxi 
can be modeled as a point-to-point erasure channel (any time = 1 or G2i[t] = 0, we consider an erasure has 



taken place). Hence from |27|, we know that for any e,6 > and sufficiently large block length, a rate of pq — 6 
is achievable from Tx2 to Rxi with decoding error probability less than or equal to e. Note that at rate pq — 6, 
both receivers wiU be able to decode and hence remove the transmitted signal of Tx2 at the end of communication 
block. If an error occurs in decoding the transmitted signal of Tx2, we consider it as error and halt the transmission 
strategy. 

On the other hand, the transmission strategy for Txi is the same as block 1 for the first b blocks (all but the last 
block). At the end of communication block j, using output feedback Unks, transmitter two has access to the bits of 
Txi communicated in Cases 11, 12, 14, and 15 during the communication block j. Transmitter two transfers these 
bits to <52-5>i|2- ^^'^ communication block, queue Ql^i is not empty, we declare error type-I and 

halt the transmission. 

Assuming that the transmission is not halted, let -^2„j.^|2 denote the number of bits in queue Q2-!>i|2- 
transmission strategy will be halted and an error type-II will occur, if N^^-^^^ > IE[A'^^^^|2] + pqm^ . From basic 
probability, we know that 

^ - Z^i=9,io,i3,i6 y^ase ij 

Using Chernoff-Hoeffding bound, we can show that the probability of errors of types I and II and decreases 
exponentially with m. 

Achievability strategy for block b + 1: Finally in block 6+1, no new data bit is transmitted and Tx2 only 
communicates the bits of Txi communicated in the previous block in Cases 11, 12, 14, and 15 as described before. 

We can show that the probability that the transmission strategy halts at any point approaches zero as m — oo. 

Decoding: At the end of block j ' + 1, Rxi decodes the transmitted message of Tx2 in block j + 1 and removes it 
from the received signal. Together with the bits it has obtained during block j, it can decode message Wj. Using 
similar idea, Rx2 uses backward decoding to cancel out interfernce in the previous blocks to decode all messages. 

This completes the achievability proof for corner ponit 

{Ri,R2) = (l-g',0) . 
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